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EXECUTIVE  SUMMARY 


This  report  provides  the  final  test  results  of  the  Automated 
Weather  Observation  System  (AWOS)  Data  Acquisition  System 
(ADAS) /Automated  Lightning  Detection  and  Reporting  System 
(ALDARS)  Operational  Test  and  Evaluation  (OT&E).  This  testing 
was  performed  by  the  ACT-320  Weather  Branch  at  the  Federal 
Aviation  Administration  (FAA)  William  J.  Hughes  Technical  Center 
and  comprised  two  phases:  OT&E  #1  for  ADAS/ALDARS  software 
version  4.18  and  OT&E  #2  for  ADAS/ALDARS  software  version  4.19. 
Software  version  4.19  corrected  all  the  Critical  and  Major 
problems  identified  in  version  4.18  and  some  of  the  Moderate 
problems.  ACT-320  recommends  a  positive  deployment  decision  for 
the  ADAS/ALDARS  software  build  4.19. 

The  ADAS/ALDARS  version  4.18  software  was  the  result  of 
modifications  to  the  original  ADAS.  These  modifications  were 
necessary  because  of  three  National  Airspace  System  (NAS)  Change 
Proposals  (NCPs) .  The  modifications  resulted  in  the  capability 
for  ADAS  to  generate  Aviation  Routine  Weather  Report. (METAR) 
format  weather  messages,  process  and  disseminate  National 
Lightning  Detection  Network  (NLDN)  lightning  data,  and  interface 
with  the  Integrated  Terminal  Weather  System  (ITWS) . 

The  following  summarizes  the  contents  of  the  Test  Results, 
Conclusions,  and  Recommendations  sections  of  the  Final  Report. 

T0St  R.0SU.ltS 

During  OT&E  #1,  the  ADAS/ALDARS  functionality  was  comprehensively 
tested.  A  total  of  38  open  Program  Trouble  Reports . (PTR)  were 
generated,  of  which  22  were  classified  as  either  Critical  or 
Major.  The  remainder  of  these  PTRs  were  designated  as  Moderate. 
OT&E  #2  included  both  Regression  testing  and  Correction  testing. 
As  a  result  of  the  Regression  testing,  seven  PTRs  were  opened, 
none  of  which  were  Critical.  The  Correction  test  results 
indicate  that  24  of  the  26  OT&E  #1  PTRs  (of  the  38  total  opened) , 
which  were  committed  to  be  fixed,  were  properly  corrected. 
Problems  still  exist  for  two  OT&E  #1  PTRs  which  were  classified 
as  Moderate.  These  PTRs  remain  open. 

As  a  result  of  OT&E  #1  and  #2,  a  total  of  21  open  PTRs  exist. 

This  total  is  the  sum  of  the  7  PTRs  that  remain  open  from  the 
OT&E  #2  Regression  phase,  the  2  PTRs  which  did  not  test 
successfully  during  the  OT&E  #2  Correction  phase,  and  the  12  OT&E 
#1  PTRs  which  were  not  scheduled  to  be  fixed  until  the  ADAS/Year 
2000  (Y2K)  software  build.  None  of  the  21  open  PTRs  are 
classified  as  Critical,  9  PTRs  are  classified  as  Major,  and  12 
are  classified  as  Moderate.  Appendix  B  contains  a  description  of 
all  open  PTRs. 
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Conclusions 

Overall,  the  ADAS  software  version  4.19  is  robust,  and  the 
original  ADAS  functionality,  which  tested  successfully  for 
versions  4.18  and  4.19,  remains  intact.  All  OT&E  #1  PTRs 
designated  as  Critical  were  successfully  tested  and  verified  as 
corrected.  No  new  Critical  PTRs  were  generated  during  OT&E  #2. 

A  few  Major  PTRs  remain  open,  but  overall  do  not  present  a 
critical  problem. 

Recommendations 

ACT-320  recommends  a  positive  deployment  decision  for  the 
ADAS/ALDARS  software  build  4.19.  This  decision  is  based  on  2 
criteria:  (1)  there  are  no  outstanding  Critical  PTRs,  and  (2) 

all  of  the  21  open  PTRs  appear  to  be  correctable.  ACT-320 
recommends  that  the  remaining  open  ADAS  software  PTRs  be 
corrected  in  the  ADAS/Y2K  software  build  and  that  the  ADAS 
documentation  PTRs  be  corrected  before  Y2K  Development  Test  and 
Evaluation  (DT&E)  commences.  ACT-320  recommends  that  all 
corrected  software  PTRs  undergo  thorough  DT&E  and  OT&E  to  verify 
that  the  software  modifications  have  been  properly  implemented. 
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1.  INTRODUCTION. 

This  report  provides  the  final  test  results  of  the  National 
Airspace  System  (NAS)  AWOS  Data  Acquisition  System 
(ADAS) /Automated  Lightning  Detection  and  Reporting  System 
(ALDARS)  Operational  Test  and  Evaluation  (OT&E) .  ADAS  designates 
the  Automated  Weather  Observation  System  (AWOS)  Data  Acquisition 
System.  ALDARS  is  an  enhancement  to  ADAS.  The  objective  of 
ALDARS  is  to  augment  the  weather  observations  from  AWOS  by^ 
reporting  the  occurrence  of  lightning  within  30  nautical  miles 
(nmi)  of  the  airport.  Along  with  the  ALDARS  enhancement  to  ADAS, 
two  additional  enhancements  were  made:  (1)  ADAS  conversion  to 

the  Aviation  Routine  Weather  Report  (METAR)  format,  and  (2)  ADAS 
communication  with  the  Integrated  Terminal  Weather  System  (ITWS) . 
All  three  enhancements  were  governed  by  approved  NAS  Change 
Proposals  (NCP) .  The  ADAS/ALDARS  OT&E  verified  that  the 
NAS-SS-1000  requirements  associated  with  these  enhancements  were 
properly  implemented. 

The  ADAS/ALDARS  OT&E  was  performed  by  members  of  the  ACT-320 
Weather  Branch  at  the  Federal  Aviation  Administration  ( FAA) 
William  J.  Hughes  Technical  Center  and  comprised  two  phases: 

OT&E  #1  for  ADAS/ALDARS  software  version  4.18  and  OT&E  #2  for 
ADAS/ALDARS  version  4.19.  Software  version  4.19  corrected  all 
the  Critical  and  Major  problems,  and  some  of  the  Moderate 
problems,  identified  in  version  4.18.  OT&E  #1  was  conducted 
during  the  period  of  July  25,  1997,  through  October  30,  1997,  and 
OT&E  #2  was  conducted  during  the  period  January  5,  1998,  through 
February  13,  1998.  Both  phases  of  the  testing  were  conducted  in 
the  ADAS  Operational  Evaluation  Facility  (OEF)  located  at  the  FAA 
William  J.  Hughes  Technical  Center  in  Atlantic  City,  N J . 

The  objectives  of  the  OT&E  #1  (software  version  4.18)  testing 
were  to  (1)  verify  new  capabilities  to  insure  that  the 
ADAS/ALDARS  met  all  the  requirements  set  forth  in  the  three 
governing  NCPs  (as  further  defined  in  section  1.3,  Background), 
and  (2)  perform  ADAS  Regression  testing  to  insure  that  the  pre¬ 
existing  ADAS  functionality  was  not  compromised  by  incorporation 
of  the  new  capabilities.  The  objectives  of  the  OT&E  #2  (software 
version  4.19)  testing  were  to  (1)  verify  that  the  26  (out  of  the 
38  total  opened)  OT&E  #1  PTRs  (as  listed  in  appendix  B) ,  which 
were  committed  to  be  fixed  in  software  version  4.19,  were 
corrected,  and  (2)  by  Regression  testing,  insure  that  all 
functions  successfully  tested  during  OT&E  #1  (version  4.18)  were 
also  correctly  implemented  in  version  4.19.  These  functions 
encompassed  many  functional  categories  including  Lightning, 

METAR,  and  ITWS . 

The  ADAS  operational  environment  for  both  phases  of  the  OT&E 
testing  closely  replicated  the  environment  at  each  Air  Route 
Traffic  Control  Center  (ARTCC) .  Actual  National  Lightning  Data 
Network  (NLDN)  hardware  was  employed  and  live  NLDN  data  used  for 
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some  parts  of  the  testing.  Additionally,  some  tests  involved  the 
use  of  simulated  NLDN  data  from  the  Interactive  Process  Simulator 
(IPS) .  Also,  the  testing  involved  use  of  both  live  and  IPS- 
simulated  AWOS/Automated  Surface  Observation  System  (ASOS) , 
Weather  Message  Switching  Center  Replacement  (WMSCR) ,  and  the 
Maintenance  Processor  Subsystem  (MPS) .  A  simulated  Coded  Time 
Source  (CTS)  was  used.  Since  the  Weather  and  Radar  Processor 
(WARP),  ITWS,  and  Data  Link  Processor  (DLP)  interfaces  do  not 
presently  exist,  the  IPS  was  used  for  the  testing  of  the 
ADAS/WARP,  ADAS /DLP,  and  ADAS/ITWS  functionality.  NOTE:  The  FAA 
does  not  plan  to  implement  the  DLP  in  its  present  state  (see 
appendix  E) . 

The  ADAS/ALDARS  new  capabilities  and  Regression  testing  performed 
during  OT&E  #1  and  the  Correction  and  Regression  testing 
performed  during  OT&E  #2  covered  the  following  functional  Test 
Categories: 

Category  AL  -  Automated  Lightning  Tests 

Category  DE  -  Degraded’’  Operations  Tests  (Error  Handling) 
Category  DTE  -  DT&E  tests  incorporated  into  OT&E 
Category  IN  -  Integration  Tests 
Category  IT  -  ITWS  Tests 
Category  ME  -  METAR 

Category  MP  -  Maintenance  Processing  Tests  (Note:  This 
category  was  not  performed  since  none  of  the  OT&E  #1  Test 
Trouble  Reports  were  addressed  in  build  4.19). 

Category  OP  -  Operational  Tests  (Software  Specification 
Review  (SSR) ,  Specialist  Interface  (SI)  menus/response  time, 
checkpoint  processing) 

Category  PT  -  PTR  and  Site  Issue  Tests 
Category  RA  -  Reliability  and  Availability 
Category  ST  -  Stress  Tests  (Updated  to  reflect  new 
configuration  and  maximum  load  requirements) 

Category  ADD  -  Additional  Tests 

1.1  PURPOSE  OF  REPORT. 

The  objectives  of  this  OT&E  Final  Test  Report  are  to: 

a.  Provide  an  accurate  account  of  the  ..combined  results  of 
both  phases  of  OT&E  testing  which  were  conducted  to  verify 
compliance  with  three  approved  NAS  Change  Proposals  (NCPs)  as 
discussed  in  the  Background  section  1 . 3,f-  below. 

b.  Explain  the  Critical  and  Major  PTRs  remaining  after  this 
testing. 

c.  Identify  other  system  deficiencies  as  discussed  in  the 
Moderate  or  Minor  PTRs  resulting  from  this  testing.  Identify  any 
time-critical  items  which  may  affect  the  life  cycle  or  other 
aspects  of  the  program. 
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d.  Provide  conclusions  of  this  testing. 

e.  Provide  either  a  deployment  recommendation  with 
substantiating  reasons  or  an  explanation  of  why  such  a 
recommendation  cannot  be  made  at  this  time  such  as  Critical 
and/or  Major  deficiencies.  In  the  case  of  a  nondeployment 
recommendation,  clarify  the  conditions  under  which  a  positive 
deployment  recommendation  could  be  made. 

1.2  SCOPE  OF  REPORT. 

The  scope  of  this  Final  Report  was  defined  by  the  following 
guidelines : 

a  This  Final  Report  will  provide  full  details  in 
substantiation  of  fulfilling  the  objectives  as  stated  in  the 
Purpose  of  Report,  section  1.1. 

b.  Full  analysis  of  the  combined  OT&E  #1  and  OT&E  #2 
testing  results  will  be  performed  in  realizing  the  objectives 
stated  in  the  Purpose  of  Report,  section  1.1. 

1 . 3  BACKGROUND . 

This  Final  Report  applies  to  both  phases  of  OT&E  testing:  OT&E 
#1  for  ADAS/ALDARS  software  version  4.18,  and  OT&E  #2  for 
ADAS/ALDARS  software  version  4.19. 

The  ADAS/ALDARS  software  version  4.18  addressed  ADAS _ 
modifications/enhancements  intended  to  achieve  compliance  wit 
the  following  three  approved  NCPs: 

a.  NCP-16133  was  approved  on  December  7,  1993,  and 
pertains  to  the  ALDARS .  This  NCP  provides  for  the  automatic 
detection  of  lightning  strikes,  and  eliminates  the  need  for 
.manual  observation  of  'thunderstorms.  This  NCP  requires  ADAS  o 

accept  lightning  data  from  the  NLDN,  filter  and  process  this 
data,  and  transmit  this  data,  via  Lightning  Activity  Data  (LAD) 
Messages,  to  the  appropriate  weather  sensor  subsystems 
(AWOS/ASOS) . 

b.  NCP-17445  was  approved  on  September  28,  1992,  and 
pertains  to  the  application  of  the  METAR  format  to  weather 
message  contents.  This  NCP  requires  ADAS  and  ASOS  to  generate 
METAR  format  messages  under  appropriate  conditions,  and  requires 
ADAS  to  process  and  disseminate  incoming  METAR  format  messages 
from  ASOS . 

c.  NCP-17331  pertains  to  the  incorporation  of  lightning 
data  into  the  ITWS.  This  NCP  integrates  ALDARS  data  with  ITWS, 
and  specifies  that  the  ADAS  provide  (transmit  to)  ITWS  with  AWOS 
format  weather  messages  and  Lightning  Detection  Data  (LDD) 
messages . 
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These  three  NCPs,  each  of  which  affects  ADAS,  are  anticipated  to 
improve  the  FAA' s  automation  of  weather  observation. 

The  ADAS/ALDARS  software  version  4.19  incorporates 
modifications/enhancements  made  to  ADAS/ALDARS  version  4.18. 

Most  of  these  modifications/enhancements  were  made  to  resolve  the 
PTRs  generated  as  a  result  of  the  ADAS/ALDARS  OT&E  #1. 
Specifically  version  4.19  is  intended  to  fix  all  the  version  4.18 
Critical  PTRs  and  most  of  the  version  4.18  Major  PTRs. 
Additionally,  version  4.19  incorporates  fixes  to  some  of  the 
version  4.18  Moderate  PTRs.  A  Critical  PTR  is  defined  as  a 
deficiency  which  will  preclude  a  positive  recommendation  for 
deployment.  A  Major  PTR  is  defined  as  a  deficiency  which  may,  in 
combination  with  other  Major  PTRs,  preclude  a  positive  deployment 
recommendation,  A  Moderate  or  Minor  PTR  is  defined  as  a 
deficiency  which  does  not  preclude  a  deployment  recommendation. 
The  identification  of  all  open  PTRs  and  their  specific  status  can 
be  found  in  appendix  B  of  this  Final  Report. 

2 .  REFERENCE  DOCUMENTS . . 

The  following  sections  list  the  applicable  documentation  and 
reference  materials  used  in  the  development  of  this  document. 

FAA  DOCUMENTS. 

FAA-STD-024b,  Preparation  of  Test  and  Evaluation  Documentation, 
was  used  for  primary  guidance  in  the  development  of  this  report. 

FAA  Standards: 

FAA-STD-024b  Preparation  of  Test  and  Evaluation 

Documentation:  August  22,  1994 

1810. 4B  FAA  NAS  Test  and  Evaluation  Program 

(October  1992) 

NAS  Documents: 

NAS-DD-1000  NAS  Level  I  Design  Document 

NAS-SR-1000  NAS  System  Requirements  Specification 

(SRS) 

NAS-SS-1000  NAS  System  Specification 

NAS-MD-110  Test  and  Evaluation  (T&E)  Terms  and 

Definitions  for  the  National  Airspace 
System  (March  27,  1987) 

NAS -MD-792  Operational  Requirements  for  the 

Remote  Maintenance  Monitoring  System 
(RMMS )  (June  1984) 
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NAS-MD-7  93 


RMMS  Functional  Requirements  for  the 
RMS  (February  28,  1986) 


Other  Documents: 

NCP-17445  FAA’s  Conversion  to  Aviation  Routine 

Weather  Report  (METAR)  and  Terminal 
Aerodrome  Forecast  (TAF)  Weather 
Messages  (September  28,  1992) 

NCP-16133  Automated  Thunderstorm  Detection 

Requirements  for  AS OS  and  ADAS 
(December  7,  1993) 

NCP-17331  Integrated  Terminal  Weather  System 

( ITWS )  Requirements  for  ADAS 
(October  24,  1994) 


3.  SYSTEM  DESCRIPTION. 

3.1  MISSION  REVIEW.  ' 

The  AWOS  ADAS  is  a  weather  processing  subsystem  of  the  Air 
Traffic  Control  (ATC)  NAS.  The  ADAS  collects,  archives, 
processes,  and  disseminates  data  acquired  from  various  AWOSs 
AWOS-ASOSs,  Federal  AWOS,  and  Non-Federal  AWOS)  in  the  NAS. 

An  ADAS  system  is  located  in  each  of  the  22  Air  Route  Traffic 
Control  Centers  /Area  Control  Facilities  (ARTCC/ACF) .  Each  ADAS 
acquires  surface  weather  observation  data  from  up  to  137 
ASOSs/AWOSs  within  the  ADAS  local  area  via  multidrop 
communications  links,  and  processes  and  disseminates  the  data  to 
WARPs,  the  ITWS,  the  WMSCR,  and  to  DLPs.  The  ADAS  acquires. LDD 
from  the  NLDN,  and  generates  and  transmits  LAD  messages  to  AWOS 
and  ASOS.  LDD  messages  are  transmitted  to  ITWS.  The  ADAS,  in 
conformance  with  the  RMMS  requirements,  incorporates  a  Remote 
Monitoring  System  (RMS)  capability,  and  transmits  maintenance 
data  to  the  MPS  in  response  to  commands  from  the  MPS. 

3.2  TEST  SYSTEM  CONFIGURATION. 

As  discussed  in  section  1,  Introduction,  the  OT&E  testing 
comprised  two  phases:  OT&E  #1  for  ADAS/ALDARS  software  version 
4.18  and  OT&E  #2  for  ADAS/ALDARS  version  4.19.  All  of  the 
Critical  and  most  of  the  Major  PTRs  opened  during  OT&E  #1  were 
resolved  in  version  4.19,  and  this  is  essentially  the  software 
which  will  be  used  in  the  operational  system.  The  hardware  used 
during  both  OT&E  phases  is  identical  to  that  of  the  operational 
system,  except  that  some  of  the  interfaces  were  simulated  rather 
than  "live."  The  interfaces  used  during  the  testing  are 
discussed  in  section  3.3,  Interfaces. 
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The  ADAS  hardware  architecture  consists  of  the  following  four 
major  components:  Processor  Assembly,  Input/Output  (I/O) 
Communications  Controllers,  System  Control  Peripherals,  and  NLDN 
Data  Reception  Hardware. 

a.  Processor  Assembly  -  The  Processor  Assembly  comprises 
seven  Line  Replaceable  Units  (LRU's): 

1.  One  single  board  computer  with  32-megahertz  (MHz) 
processing  power,  16-megabytes  (MB)  main  memory.  Small  Computer 
Systems  Interface  (SCSI)  mass  storage  controller,  four  serial 
interfaces,  and  one  parallel  printer  port. 

2.  One  fixed  disk  drive  with  172-MB  formatted  capacity, 
16.5-millisecond  (ms)  average  access  time,  and  1.25  MB  per  second 
transfer  rate . 

3.  One  cartridge  tape  drive  with  150  MB  capacity  and 
112-kilobytes  (Kb)  per  second  transfer  rate . 

4.  One  floppy  disk  drive  with  650  Kb  formatted 

capacity. 

5.  One  Versa  Module  (VME)  chassis  including  backplane 
and  fans,  rack  mountable,  with  12  VME  bus  slots  for  plug-in 
boards  plus  space  for  mass  storage  devices. 

6.  One  115-vac/60-hertz  (Hz)  power  supply  with  650 
watts  output  capacity. 

7.  One  remote  maintenance  interface  (I/F)  dial-up  mode, 
providing  up  to  2400-bits  per  second  (bps)  transfer  rate. 

b.  I/O.  Communications  Controllers  -  The  communications 
controllers  comprise: 

1.  An  X.25  communications  controller  for 
communications,  via  the  National  Airspace  Data  Interface  Network 
(NADIN) ,  with  the  WMSCR,  WARP,  ITWS,  MPS,  and  DLP . 

2.  Eight  six-channel  communications  controllers  for 
High  Level  Data  Link  Control  (HDLC)  Normal  Response  Mode  (NRM) 
Multidrop  communications  with  AWOS  (AWOS/ASOS/AOS) ,  and  allowing, 
for  up  to  10  AWOSs  on  each  assigned  channel. 

3.  Two  four-channel  RS232C  communications  controllers 
used  to  input  NLDN  lightning  strike  data,  and  for  communications 
with  the  peripheral  devices  such  as  terminals  and  printers. 

4.  Communications  Transition  Modules  (CTM)  which  are 
applied  to  the  communications  controllers  and  provide  the 
physical  interface  (electrical/mechanical)  interface  to  the 
circuits  served  by  the  controllers. 
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c.  System  Control  Peripherals  -  The  System  Control 
Peripherals  comprise  two  types: 

1.  Two  Video  Display  Terminals,  one  for  the  UNIX 
Console  and  one  for  the  ADAS  Specialist  Console. 

2.  Two  printers  (280  characters  per  second  (cps) ) ,  one 
for  the  System  Event  Log  and  one  for  the  ADAS  Specialist  Console 

Log. 

d.  NLDN  Data  Reception  Hardware  -  The  ADAS  NLDN  Data 
Reception  Hardware  comprises: 

1.  An  antenna  dish  with  Low  Noise  Block 

2.  An  interfacility  link  cable 

3.  A  data  receiver  and  buffer. 

The  ADAS  software  architecture  is  based  on  one  Computer  Software 
Configuration  Item  (CSCI)  which  comprises  the  following  15  Top 
Level  Computer  Software  Components  (TLCSCs) . 

a.  Communications  Control  (CCN)  -  Coordinates  the 
sequencing  of  the  other  communications  TLCSCs. 

b.  Communications  Time  Processing  (CTM)  -  Manages  the 

interface  to  CTS  and  maintains  ADAS  system  time. 

c.  Communications  High  Level  Data  Link  Control  (HDLC)  . 
Processing  (CHD)  -  Manages  the  connections  to  the  AWOS  stations 
and  the  transfer  of  data  to  and  from  the  AWOS  stations. 

d.  Communications  DLP/WARP  Processing  (CDL)  -  Manages  the 
connection  to  DLP  and  WARP  and  controls  the  dissemination  of  AWOS 
data  to  these  devices. 

e.  Communications  WMSCR  Processing  (CWM)  -  Manages  the 
connection  to  WMSCR  and  disseminates  METAR  format  messages  to 
WMSCR. 

f.  Communications  Maintenance  Processor  Subsystem  (MPS) 
Processing  (CMP)  -  Manages  the  connection  to  MPS  and  controls  the 
transfer  of  data  to  and  from  the  MPS. 

g.  Communications  ITWS  Processing  (CIT)  -  Manages  the 
logical  connection  to  all  configured  ITWS,  and  disseminates  AWOS 
format  messages  and  LDD  messages  to  these  systems. 

h.  Weather  Data/Conversion  Processing  (WDP)  -  Performs 
trend  analysis  of  AWOS  format  messages,  and  generates  special, 
periodic,  and  hourly  METAR  format  messages. 
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i.  Weather  Storage  Processing  (WSP)  -  Performs  archival 
processing  for  storage  and  retrieval  handling  of  Metar  messages. 

j .  Maintenance  Processing  (MP)  -  Generates  performance 
reports,  alarms,  alerts,  and  state  change  messages  in  support  of 
the  MPS. 

k.  System  Log  (SL)  -  Accepts  error  messages  and  events  from 
all  TLCSCs  and  enters  them  in  the  error  and  event  logs. 

l.  Mission  Cycle  Control  (MCC)  -  Controls  and  sequences  the 
1-minute  mission  cycle. 

m.  Startup  Shut  down  Recovery  (SSR)  -  Handles  system 
initialization,  shut  down,  and  general  process  control  of  all 
TLCSCs. 

n.  Specialist  Interface  (SI)  -  Provides  an  interface  to 
allow  the  ADAS  specialist  to  access  and  control  the  ADAS  system. 

o.  Lightning  Processing  (LHT)  -  Manages  the  logical 
connection  to  the  commercial  NLDN,  performs  flash  and 
geographical  screening  on  incoming  LDD  messages,  generates  LAD 
messages  for  distribution  to  lightning  configured  AWOS  sites,  and 
maintains  internal  RMS  data  points  for  delivery  to  the  MP  TLCSC 
upon  request . 

3.3.  INTERFACES. 

As  mentioned  in  section  1,  Introduction,  much  of  the  ADAS/ALDARS 
OT&E  testing  involved  use  of  the  Interactive  Process  Simulator 
(IPS)  to  simulate  those  interfaces  not  operational  ("live") .  In 
the  following  discussion  of  the  interfaces  employed  during  the 
OT&E  testing,  the  extent  of  IPS  usage  will  be  identified. 

a.  AWOS/ASOS  -  The  Operational  ADAS/ALDARS  involves  a 
maximum  configuration  of  50  ASOS  and  25  AWOS  stations  connected 
to  ADAS/ALDARS  via  the  eight  six-channel  HDLC  multidrop 
communications  controllers.  Up  to  10  stations  can  be  connected 
to  any  one  of  the  48  channels.  However,  only  three  "live" 
stations  were  available  during  the  testing  -  two  AWOS  type  and 
one  ASOS  type.  Therefore,  much  of  the  testing  involved  IPS- 
simulation  of  these  stations.  Intensive  use  was  made  of  the 
"live"  stations  to  verify  the  link  protocol (HDLC  -  NRM) , 
command/response  timing,  and  the  correctness  of  the  processing  of 
the  LAD  messages  sent  them. 

The  IPS  was  used  to  (1)  simulate  multidrop  configurations,  (2) 
simulate  various  message  scenarios  involving  the  generation  of 
different  message  types  (METAR,  Aviation  Selected  Special  Weather 
Report  (SPECI),  Standard  Hydrological  Exchange  Format  (SHEF) ) 
from  ASOS  stations  and  AWOS  format  messages  from  AWOS  stations 
which  would  precipitate  conversion  to  METAR  by  the  ADAS/ALDARS, 
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and  (3)  simulate  the  maximum  connected  load  at  an  operational 
site  for  stress  testing  the  ADAS/ALDARS  Central  Processing  Unit 
(CPU)  processing  capability  and  1-minute  mission  cycle 
compliance. 

b.  NLDN  -  The  ADAS/ALDARS  OT&E  included  tests  with  the 
"live"  NLDN  source  as  well  as  tests  with  IPS-simulated  NLDN  data. 
Tests  with  the  "live"  NLDN  confirmed  proper  operation  of  the  NLDN 
reception  hardware.  Proper  operation  of  the  lightning  processing 
software  was  confirmed  by  adjusting  the  coordinates  of  the  live 
AWOS  stations  in  the  test  to  conform  to  the  incoming  lightning 
data.  Tests  with  IPS-simulated  data  enabled  the  evaluation  of 
the  ADAS  processing  of  concurrent  lightning  strikes  in  different 
geographical  areas,  and  in  different  sectors  and  zones. 

c.  WMSCR  -  The  ADAS/ALDARS  OT&E  included  tests  with  the 
IPS-simulated  WMSCR  as  well  tests  with  a  "live"  WMSCR  located  at 
the  Technical  Center.  Since  the  ADAS  has  only  one  X.25  port 
available,  the  simulated  WMSCR  had  to  be  used  whenever  the 
ADAS/ALDARS  tests  involved  other  ADAS  X.25  users  which  were  not 
available  as  "live,"  i.e.,  WARP,  ITWS,  DLP,  and  MPS  (when  "live" 
MPS  was  not  available.  Since  ADAS  communicates  with  the  X.25 
users  via  NADIN  II,  the  IPS  simulated  NADIN  II  to  the  extent 
necessary.  ADAS/ALDARS  testing  with  the  "live"  WMSCR,  via  the 
test  NADIN  II  Node  located  at  the  Technical  Center,  demonstrated 
the  ADAS/ALDARS  capability  to  function  with  the  actual  hardware. 

d.  MPS  -  The  ADAS/ALDARS  OT&E  also  included  tests  with  the 
IPS-simulated  MPS  as  well  as  the  "live"  MPS  located  at  the 
Technical  Center.  The  rationale  underlying  when  testing  was  done 
with  the  "live"  MPS  via  the  Technical  Center.  NADIN  II  Node  versus 
with  the  IPS-simulated  MPS  and  simulated  NADIN  II  node  is 
essentially  the  same  as  for  the  WMSCR  stated  above. 

e.  WARP,  ITWS,  DLP  -  The  ADAS/ALDARS  OT&E  employed  the  IPS 
simulator  for  all  tests  involving  the  WARP,  ITWS,  and  DLP  due  to 
the  unavailability  of  these  subsystems  at  present.  NOTE:  The  FAA 
does  not  plan  to  implement  the  DLP  in  its  present  state  (see 
appendix  E) . 

4.  TEST  AND  EVALUATION  DESCRIPTION. 

4.1  TEST  SCHEDULE  AND  LOCATIONS. 

Both  phases  of  the  ADAS/ALDARS  OT&E  testing,  designated  OT&E  #1 
and  OT&E  #2  were  performed  at  the  FAA  William  J.  Hughes  Technical 
Center.  OT&E  #1  was  conducted  during  the  period  July  25,  1997, 
through  October  30,  1997,  and  OT&E  #2  was  conducted  during  the 
period  January  5,  1998,  through  February  13,  1998. 
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4.2  PARTICIPANTS. 

Both  phases  of  the  ADAS/ALDARS  OT&E  testing  were  conducted  by 
members  of  the  ACT-320  Weather  Branch.  Personnel  involved: 

Don  Groot  -  Test  Director  and  ALDARS  Processing  Testing 

Ed  Schlain  -  Communications  Interfaces  Testing  (OT&E  #2 
only) 

Jock  Stratton  -  Degraded  Operations,  METAR,  Operational,  and 
Stress  Testing 

Hugh  Vuong  -  Communications  Interfaces  Testing 

Note:  ACT-330  personnel  performed  RMS  testing.  See  appendix  D 
for  further  details. 

4.3  TEST  AND  SPECIALIZED  EQUIPMENT. 

Various  test  and  specialized  equipment  were  employed  during  both 
OT&E  #1  and  OT&E  #2.  A  patch  panel  was  utilized  to  facilitate 
establishing  a  variety  of  test  connections  and  four  Protocol 
Analyzers  were  used  to  monitor  and  store  data  exchanged  on  the 
AWOS  circuits  and  on  the  X.25  circuit  to  NAD IN  II.  The  patch 
panel  permitted,  via  a  plug-in  patch  cord,  the  ready  connection  . 
of  any  of  the  three  "live"  AWOS  circuits  (each  with  one  station) 
and  the  "live"  X.25  circuit  to  any  of  the  four  Protocol 
Analyzers.  This  was  an  important  facility  since  the  Protocol 
Analyzers  differed  with  respect  to  the  features  offered;  e.g., 
data  display  format;  on-screen  interpretation  of  the  data 
displayed  including  protocol  commands,  responses,  and  error 
conditions;  capability  of  storing  the  data  exchanged  on  the 
communications  link;  and  the  capability  to  playback  and  interpret 
this  data  on  a  personal  computer  (PC) .  The  patch  panel  also 
facilitated  the  diversion  of  an  ADAS/ALDARS  American  Standard 
Code  for  Information  Interchange  (ASCII)  data  stream  printer 
output  to  a  PC  which  would  capture  this  information  in  a  file 
established  with  the  ProcomPlus  software. 

The  Protocol  Analyzers  employed  included  two  Telebyte  PC  Comscope 
Model  904,  one  Interview  7200  Turbo,  and  one  Digilog  Model  900. 

4.4  TEST  DETAILS. 

4.4.1  Category  AL  -  ALDARS. 

4. 4. 1.1  Test  AL-01A  -  ALDARS  Interface. 

The  objective  of  this  test  was  to  verify  particular  ALDARS  NAS- 
SS-1000  requirements  (see  appendix  A) .  In  order  to  meet  this 
objective,  this  test  used  a  simulated  valid  LDD  Flash  Messages 
and  15  simulated  AWOS  stations  to  verify  that  ADAS: 

a.  established  and  maintained  receive-only  communications, 
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b.  properly  received  valid  data  input  messages. 

4.4.1. 1.1  Description. 

The  IPS  was  configured  to  correspond  to  the  ADAS  configuration 
including  the  simulation  of  5  circuits. with  15  AWOS  stations. 

One  circuit  had  10  stations  (drops) .  The  other  four  circuits  had 
five  stations.  The  reason  to  simulate  15  stations  was  to 
simulate  an  ADAS  operational  environment.  This  served  to  verify 
that  the  ADAS  software/hardware  (SW/HW)  could  properly  service  a 
NLDN  together  with  many  (simulated)  AWOS  stations.  Additionally, 
IPS  was  configured  to  simulate  one  ITWS,  and  one  Lightning  Script 
which  contained  valid  LDD  Flash  Messages. 

4. 4.1.1. 2  Data  Reduction  and  Analysis  Method. 

The  data  file  on  the  Data  Capture  PC  (PCI)  that  captured  IPS  data 
contained  the  following: 

HEX  display  printouts  for  ITWS1  LDD 
NLDN  LDD  MESSAGES  file:  oAL- 0 1AA . NLDN 
ITWS1  LDD  MESSAGES  file:  iAL-OlAA.LDD 

The  data  file  on  the  Data  Capture  PC  (PC2)  that  captured  ADAS 
data  contained  the  following: 

a.  The  Communications  Datapoint  file  is  AL-01A.com: 

The  NLDN  Communications  Datapoint 
The  ITWS1  Communications  Datapoint 

b.  The  Event  Log  file  is  AL-OlA.evt 

61  --  EVENT  Log  for  status  of  the  ITWS  connection  has 

changed.  ; 

62  —  EVENT  Log  for  status  of  the  NLDN  connection  has 

changed. 

The  HEX  printouts  and  NLDN  LDD  message  file  were  used  to  verify 
that  the  ADAS/ITWSs  properly  received  valid  LDD  input  messages: 

a.  Application  Data  Unit  (ADU)  maximum  size  did  not  exceed 
4096  bytes  per  ADU 

b.  The  single  ADU  contained  only  LDD  data 

c.  The  ADU  World  Meteorological  Organization ^  (WMO) 

(envelope  head,  abbreviated  heading  and  tail)  containing  only  LDD 
data  was  properly  formatted  and  fields  were  correct. 

The  test  data  in  the  NLDN  LDD  Messages  out  file  and  the  ITWS1  LDD 
Incoming  Message  Log  (IML)  file  were  examined  to  verify  that  the 
LDD  bound  for  ITWS  moved  through  the  ADAS  within  5  seconds. 
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Reviewed  the  ADAS  Event  Log  for  events  pertinent  to  this  test, 
particularly  Event  Types  (61,  62) .  \ 

Reviewed  the  Communications  Datapoint  obtained  from  the  ADAS  SI 
to  verify  the  ADAS/NLDN  Interface  and  ADAS/ITWSs  Interface. 

For  this  test,  three  out  of  three  Evaluation  Criteria  passed. 

The  Evaluation  Criteria  used  to  determine  that  this  test's 
requirements  were  verified  are  contained  in  appendix  C. 

4.4. 1.1.3  Results  and  Discussion. 

The  following  paragraphs:  contain  cross-reference  formal  test 
data;  provide  details  of  significant  problems  encountered  during 
test  execution;  and  list  the  status  of  OT&E  PTRs  generated  with 
respect  to  test  AL-01A. 

4 . 4 . 1 . 1 . 3 . 1  Data .  1. 

Due  to  the  volume  of  the  cross-referenced  test  data,  it  has  not 
been  included  in  this  paragraph.  The  data  has  been  included  in 
the  appendix  C  paragraph  associated  with  test  AL-01A. 

4. 4. 1.1. 3. 2  Significant  Problems. 

None 

4. 4. 1.1. 3. 3  PTRs  Generated. 

None 

4. 4. 1.2  Test  AL-01B  -  ALDARS  Interface. 

The  objective  of  this  test  was  to  verify  particular  ALDARS  NAS- 
SS-1000  requirements  (see  appendix  A) .  In  order  to  meet  this 
objective,  this  test  used  the  simulated  valid  LDD  Flash  Messages 
with  maximum  length  (20  Flash  Records)  and  15  simulated  AWOS 
stations  to  verify  that  ADAS: 

a.  established  and  maintained  receive-only  communications, 

b.  properly  received  valid  data  input  messages. 

4. 4. 1.2.1  Description. 

The  IPS  was  configured  to  correspond  to  the  ADAS  configuration, 
including . the  simulation  of  5  circuits  with  15  AWOS  stations.  . 
One  circuit  had  10  stations  (drops) .  The  other  four  circuits  had 
five  stations.  The  reason  to  simulate  15  stations  was  to 
simulate  an  ADAS  operational  environment.  This  served  to  verify 
that  the  ADAS  software/hardware  (SW/HW)  could  properly 
communicate  with  the  NLDN  and  many  (simulated)  AWOS  stations. 
Additionally,  the  IPS  was  configured  to  simulate  1  ITWS,  and  the 
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Lightning  Simulator  Script  which  contained  a  valid  LDD  Flash 
Messages  with  maximum  length  (20  Flash  Records) . 

4. 4. 1.2. 2  Data  Reduction  and  Analysis  Method. 

The  data  file  on  the _ Data  Capture  PC  (PCI)  that  captured  IPS  data 
contained  the  following: 

HEX  display  printouts  for  ITWS1  LDD 
NLDN  LDD  MESSAGES  file:  oAL-OlBA. NLDN 
ITWS1  LDD  MESSAGES  file:  iAL-OlBA. LDD 

The  data  file  on  the  Data  Capture  PC  (PC2)  that'  captured  ADAS 
data  contained  the  following: 

a.  The  Communications  Datapoint  file  is  AL-01B.com: 

The  NLDN  Communications  Datapoint 
The  ITWS1  Communications  Datapoint 

b.  The  Event  Log  file  is  AL-OlB.evt 

61 —  EVENT  Log  for  status  of  the  ITWS  connection  has 

rhanaed 

62  —  EVENT  Log  for  status  of  the  NLDN  connection  has 

changed. 

The  HEX  printouts  and  NLDN  LDD  message  file  were  examined  to 
verify  that  the  ADAS/ITWSs  properly  received  valid  LDD  input 
messages: 

1.  ADU  maximum  size  did  not  exceed  4096  bytes  per  ADU 

2.  The  single  ADU  contained  only  LDD  data 

3.  The  ADU  WMO  (envelope  head,  abbreviated  heading  and 
tail ) containing  only  LDD  data  was  properly  formatted  and  fields 
were  correct. 

The  test  data  in  the  NLDN  LDD  Messages  out  file  and  the  ITWSl  LDD 
(IML)  file  were  examined  to  verify  that  the  LDD  bound  for  ITWS 
moved  through  the  ADAS  within  5  seconds. 

Reviewed  the  ADAS  Event  Log  for  events  pertinent  to  this  test, 
particularly  Event  Types  (61,  62) . 

Reviewed  the  Communications  Datapoint  obtained  from  the  ADAS  SI 
to  verify  that  the  NLDN  and  the  ITWSs  properly  interfaced  with 
ADAS . 

For  this  test,  three  out  of  three  Evaluation  Criteria  passed. 

The  Evaluation  Criteria  used  to  determine ^ that  this  test's 
requirements  were  verified  are  contained  in  appendix  C. 
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4. 4. 1.2. 3  Results  and  Discussion. 

The  following  paragraphs:  contain  cross-reference  formal  test 
data;  provide  details  of  significant  problems  encountered  during 
test  execution;  and  list  the  status  of  OT&E  PTRs  generated  with 
respect  to  test  AL-01B.  . 

4. 4. 1.2. 3.1  Data. 

Due  to  the  volume  of  the  cross-referenced  test  data,  it  has  not 
been  included  in  this  paragraph.  The  data  has  been  included  in 
the  appendix  C  paragraph  associated  with  test  AL-01B. 

4. 4. 1.2. 3. 2  Significant  Problems. 

None 

4. 4. 1.2. 3. 3  PTRs  Generated,. 


None 

4. 4. 1.3  Test  AL-01C  -  ALDARS  Interface. 

The  objective  of  this  test  was  to  verify  particular  ALDARS  NAS- 
SS-1000  requirements  (see  appendix  A) .  In  order  to  meet  this 
objective,  this  test  used  a  simulated  valid/invalid  LDD  Flash 
Messages  and  15  simulated  AWOS  stations  to  verify  that  the  ADAS: 

a.  established  and  maintained  receive-only  communications, 

b.  properly  received  valid  data  input  messages, 

c.  detected  error  conditions  in  the  data  input  stream. 

4. 4. 1.3.1  Description. 

The  IPS  was  configured  to  correspond  to  the  ADAS  configuration, 
including  the  simulation  of  5  circuits  with  15  AWOS  stations. 

One  circuit  had  10  stations  (drops) .  The  other  four  circuits  had 
five  stations.  The  reason  to  simulate  15  stations  was  to 
simulate  an  ADAS  operational  environment.  This  served  to  verify 
that  the  ADAS  software/hardware  (SW/HW)  could  properly 
communicate  with  the  NLDN  and' many  (simulated)  AWOS  stations. 
Additionally,  the  IPS  was  configured  to  simulate  one  ITWS  and  one 
Lightning  Simulator  Script  which  contained  valid  LDD  Flash 
Messages  and  invalid  LDD  Flash  Messages  of  various  types.  These 
valid/invalid  Flash  Messages  were  simulated  simultaneously. 

4. 4. 1.3. 2  Data  Reduction  and  Analysis  Method. 

The  data  file  on  the  Data  Capture  PC  (PCI)  that  captured  IPS  data 
contained  the  following: 

HEX  display  printouts  for  ITWS1  LDD 
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NLDN  LDD  MESSAGES  file:  oAL-OlCA.NLDN 
ITWS1  LDD  MESSAGES  file:  iAL-OlCA. LDD 

The  data  file  on  the  Data  Capture  PC  (PC2)  that  captured  ADAS 
data  contained  the  following: 

a.  The  Communications  Datapoint  file  is  AL-01C.com: 

The  NLDN  Communications  Datapoint 
The  ITWS1  Communications  Datapoint 

b.  The  Event  Log  file  is  AL-OIC.evt 

61  __  EVENT  Log  for  status  of  the  ITWS  connection  had 

changed.  ,  , 

62  —  EVENT  Log  for  status  of  the  NLDN  connection  had 

changed.  .  ,  '  • 

21  --  EVENT  Log  for  status  of  the  erroneous  message,  haa 

been  triggered  by  system  logging. 

The  HEX  printouts  and  NLDN  LDD  message  file  were  examined  to 
verify  that  the  ADAS/ITWSs  properly  received  valid  LDD  input 
messages : 

1.  ADU  maximum  size  did  not  exceed  4096  bytes  per  ADU 

2.  The  single  ADU  contained  only  LDD  data 

3.  The  ADU  WMO  (envelope  head,  abbreviated  heading  and 
tail)  containing  only  LDD  data  was  properly  formatted  and  fields 
were  correct . 

The  test  data  in  the  NLDN  LDD  Messages  out  file  and  the  ITWS1  LDD 
( IML)  file  were  examined  to  verify  that  the  LDD  bound  for  ITWS 
moved  through  the  ADAS  within  5  seconds . 

Reviewed  the  ADAS  Event  Log  for  events  pertinent  to  this  test, 
particularly  Event  Types  (61,  62,  21). 

Reviewed  the  Communications  Datapoint  obtained  from  the  ADAS  SI 
to  verify  that  the  NLDN  and  the  ITWSs  properly  interfaced  with 
ADAS . 

For  this  test,  four  out  of  four  Evaluation  Criteria  passed.  The 
Evaluation  Criteria  used  to  determine  that  this  test's 
requirements  were  verified  are  contained  in  appendix  C. 

4. 4. 1.3. 3  Results  and  Discussion. 

The  following  paragraphs:  contain  cross-reference  formal  test^ 
data;  provide  details  of  significant  problems  encountered  during 
test  execution;  and  list  the  status  of  OT&E  PTRs  generated  with 
respect  to  test  AL-01C. 
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4. 4. 1.3. 3.1  Data. 

Due  to  the  volume  of  the  cross-referenced  test  data,  it  has  not 
been  included  in  this  paragraph.  The  data  has  been  included  in 
the  appendix  C  paragraph  associated  with  test  AL-01C. 

4. 4. 1.3. 3. 2  Significant  Problems. 

None 

4. 4. 1.3. 3. 3  PTRs  Generated . 

None 

4. 4. 1.4  Test  AL-01D  -  ALDARS  Interface. 

The  objective  of  this  test  was  to  verify  particular  ALDARS  NAS- 
SS-1000  requirements  (see  appendix  A) .  In  order  to  meet  this 
objective,  this  test  used  50  simulated  AWOS  stations  and  "live" 
NLDN  to  verify  that  ADAS: 

a.  established  system  timing  constraints, 

b.  Electrically/mechanically  interfaced  properly  with  the 
"live"  NLDN. 

c.  detected  error  conditions  in  the  data  input  stream, 

d.  properly  received  valid  data  input  messages, 

e.  properly  maintained  performance  data  points  reflecting 
the  status/condition  of  the  NLDN/  ADAS  interface. 

4. 4. 1.4.1  Description. 

The  ADAS  was  configured  to  correspond  to  the  IPS  with  a  "live" 
NLDN  (interface)  configuration.  Additionally,  the  ADAS  was 
configured  to  geographically  cover  the  continental  U.S.  This  was 
accomplished  by  accessing  the  site  adaptation  data  using  the  ADAS 
Specialist  Console (ASC) .  With  the  ADAS  configured  in  this  way, 
the  ITWS  simulators  received  all  LDD  Flash  Messages.  This 
allowed  for  easier  verification  that  ADAS  properly  disseminated 
LDD  Flash  Messages  to  ITWS. 

The  IPS  was  configured  to  correspond  to  the  ADAS  configuration 
including  the  simulation  of  20  circuits  with  50  AWOS  stations. 
Simulated  circuit  connectivity  spreader  over  all  eight  Interface 
Control  Cards  (ICCs)  and  with  a  mixture  of  Direct  Memory  Access 
(DMA)  and  Interrupt  Request  (IRQ)  SW  Handling  channels.  One 
simulated  channel  had  10  stations  (drops) .  The  other  19  channels 
had  a  total  of  40  stations.  The  reason  to  simulate  50  stations 
was  to  simulate  an  ADAS  operational  environment.  This  served  to 
verify  that  the  ADAS  SW/HW  could  properly  service,  in  compliance 
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with  established  system  timing  constraints  and  throughput 
requirements,  an  NLDN  together  with  many  (simulated)  AWOS 
stations.  Additionally,  the  IPS  was  configured  to  simulate  six 

ITWSs . 

A  Line  Monitor/Protocol  Analyzer  (LMPA)  connected  in  series  with 
the  ADAS/NLDN  Monitor  port.  The  LMPA  data  recorded  were  examined 
to  verify  that  the  LDD  Messages  transmitted  from  "live"  NLDN  to 
ADAS. 

4. 4. 1.4. 2  Data  Reduction  and  Analysis  Method. 

The  data  file  on  the  Data  Capture  PC  (PCI)  that  captured  IPS  data 
contained  the  following : 

HEX  display  printouts  for  ITWS1  LDD 
HEX  display  printouts  for  ITWS6  LDD 
ITWS1  LDD  MESSAGES  file:  iAL-OlAA. LDD 
ITWS1  LDD  MESSAGES  file:  iAL-OlAA.LDD 

The  data  file  on  the  Data  Capture  PC  (PC2)  that  captured  ADAS 
data  contained  the  following: 

a.  The  Communications  Datapoint  file  is  AL-01D.com: 

The  NLDN  Communications  Datapoint 
The  ITWS1  Communications  Datapoint 
The  ITWS6  Communications  Datapoint 

b.  The  Event  Log  file  is  AL-OlD.evt 

61  —  EVENT  Log  for  status  of  the  ITWS  connection  had 

changed. 

62  —  EVENT  Log  for  status  of  the  NLDN  connection  had 

changed. 

21  —  EVENT  Log  for  status  of  the  erroneous  message,  had 
been  triggered  by  system  logging. 

The  LMPA  data  captured  transferred  to  the  Data  Capture  PC  (PC3) 
by  using  Procomm  Plus  software.  The  file  named  is  an  AL-OlD.lmp. 

The  "AL-OlD.lmp"  file  and  ITWS (1,6)  LDD  incoming  message  file 
were  examined  to  verify  that  the  "live"  NLDN  properly  interfaced 
with  ADAS.  Verifications  consisted  of  the  ADAS  SW/HW  which 
properly  accepted  and  interpreted  the  NLDN  data  stream  with  the 
characteristics:  serial,  asynchronous,  1200  baud  rate,  8  data 
bits,  1  stop  bit,  and  no  parity. 

The  HEX  printouts  were  used  to  verify  that  the  ADAS/ITWS  properly 
received  valid  LDD  input  messages: 

1.  ADU  maximum  size  did  not  exceed  4096  bytes  per  ADU 
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2.  The  single  ADU  contained  only  LDD  data 

3.  The  ADU  WMO  (envelope  head,  abbreviated  heading  and 
tail)  containing  only  LDD  data  was  properly  formatted  and  fields 
were  correct. 

Reviewed  the  ADAS  Event  Log  for  events  pertinent  to  this  test, 
particularly  Event  Types  (05,  61,  62,  21). 

Reviewed  the  Communications  Datapoint  obtained  from  the  ADAS  SI 
to  verify  that  the  NLDN  and  ITWSs  properly  interfaced  with  ADAS. 

For  this  test,  four  out  of  four  Evaluation  Criteria  passed.  The 
Evaluation  Criteria  used  to  determine  that  this  test's 
requirements  were  verified  are  contained  in  appendix  C. 

4. 4. 1.4. 3  Results  and  Discussion. 

The  following  paragraphs:  contain  cross-reference  formal  test 
data;  provide  details  of  significant  problems  encountered  during 
test  execution;  and  list  the  status  of  OT&E  PTRs  generated  with 
respect  to  test  AL-01D. 

4. 4. 1.4. 3.1  Data. 

Due  to  the  volume  of  the  cross-referenced  test  data,  it  has  not 
been  included  in  this  paragraph.  The  data  has  been  included  in 
the  appendix  C  paragraph  associated  with  test  AL-01D. 

4. 4. 1.4. 3. 2  Significant  Problems. 

During  OTE#l,  NLDN  Interface  test  AL-01D,  the  communication 
status  between  NLDN  and  ADAS  failed  (refer  to  PTR  OTE-OOl).  DME 
Corporation  (DME)  corrected  the  problem  by  updating  the  software. 
DME  also  updated  the  hardware  setting  in  the  serial  buffer  box. 
During  the  DT&E#2  and  OT&E#2,  the  problem  detailed  in  PTR  OTE-OOl 
was  verified  as  corrected.  However,  a  new  PTR  OTE-047  was 
generated.  The  ADAS/ALDARS  documentation  for  the  NLDN  buffer  box 
did  not  provide  either  setup  procedures  or  technical  information 
for  the  box's  four  configuration  dip  switches.  ADAS  operational 
setup  required  specific  settings  to  configure  the  buffer  box  to 
properly  interface  ADAS  with  the  NLDN. 

4. 4. 1.4. 3. 3  PTRs  Generated. 

See  appendix  B  for  complete  PTR  details.  The  PTRs  generated  with 
respect  to  this  test  are: 

Critical  PTR(s):  OTE-OOl  -  CLOSED 

Moderate  PTR(s):  OTE-047  -  OPEN 
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4. 4. 1.5  Test  AL-02A. 

The  objective  of  this  test  was  to  verify  particular  ALDARS  NAS- 
SS-1000  requirements  (see  appendix  A) . 

In  order  to  meet  this  objective,  this  test  verified  that: 

a.  ADAS  could  process,  store,  and  maintain  a  database  to 
keep  track  of  AWOSs,  ASOSs,  and  ITWSs  that  were  enabled  to 
receive  NLDN  lightning  data. 

b.  ADAS  could  properly  determine  the  proximity  of 
lightning  strikes  and  generate  a  message  for  each  AWOS/ASOS  when 
the  lightning  strikes  were  within  the  defined  geographical  areas 
surrounding  the  AWOS/ASOS. 

c.  ADAS  maintained  status  of  lightning  activity  movement 
and  identified  cessation  of  lightning  activity  for  each 
AWOS/ASOS. 

d.  ADAS  maintained  a  count  of  lightning  strikes  for  the 
last  15  minutes  for  each  of  the  10  zones/sectors  about  the  _  . 
AWOS/ASOS  Airport  Reference  Point  (ARP).  [NOTE:  ADAS  maintained 
these  counts  internally  and,  therefore,  it  could  only  be 
determined  through  code  inspections.  Code  inspections  were 
performed  at  DT&E  and  were  not  performed  during  OT&E.  However, 
ADAS  LAD  messages  do  maintain  a  15-minute  persistence  for 
lightning  activity  for  each  zone/sector.  This  capability  was 
verified  during  OT&E.] 

4. 4. 1.5.1  Description. 

This  scenario  focused  on  one  out  of  the  five  simulated  AWOSs. ^ 

The  IPS  sent  flash  records  that  fell  into  each  of  the  10  possible 
AWOS  zones/sectors.  Each  of  these  simulated  lightning  strikes 
fell  on  a  boundary  between  zones/sectors . 

The  IPS  was  scripted  using  the  Standard  and  Specified  Flash 
Message.  Flash  messages  contained  10  flashes  with  1  flash 
falling  along  the  boarder  for  each  of  the  10  zones/sectors  for 
the  AWOS.  These  flash  messages  were  generated  every  16  minutes 
to  allow  for  the  15-minute  persistence  to  clear  out  the  LAD 
messages.  The  flash  locations  in  each  zone/sector  were  varied  to 
stress  the  boundary  conditions.  Since  the  IPS  had  limitations  of 
only  placing  flashes  at  whole  integer  nmi  distances . and  whole 
integer  degrees  from  the  ARP,  boundary  conditions,  in  some  cases, 
could  only  be  marginally  stress  tested. . 

4.4.1. 5.2  Data  Reduction  and  Analysis  Method. 

NOTE:  Actual  analysis  may  find  that  some  messages  do  not  occur  at 
the  minutes  indicated  below.  This  is  the  result  of  the  delay  of 
the  IPS  sending  out  LDD  messages  as  the  script  progresses  through 
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its  life  cycle.  The  following  is  a  description  as  to  why  this 
occurs . 

At  the  beginning  of  the  script,  the  LDD  flash  messages  are  sent 
to  ADAS  at  the  beginning  of  the  minute  or  mission  cycle.  As  the 
script  progresses,  the  LDD  flash  messages  experience  a  delay  in 
being  sent  to  ADAS  and,  therefore,  are  sent  to  ADAS  later  and 
later  into  the  minute/mission  cycle.  As  a  result,  when  the 
script  first  starts,  the  LDD  messages  sent  at  the  top  of  the 
minutes  get  processed  by  ADAS  during  that  minute's  mission  cycle. 
But  at  some  point  during  the  life  of  the  script,  the  LDD  message 
will  be  sent  to  ADAS  too  late  into  the  mission  cycle  and  as  a 
result  will  not  get  processed  during  that  minute's  mission  cycle. 
When  this  occurs  the  LDD  message  will  not  get  processed  until  the 
next  minute's  mission  cycle  and,  therefore,  it  appears  as  if  ADAS 
"skipped"  processing  LDD  messages  for  1  minute. 

LAD  messages: 

The  LAD  messages  were  logged"  on  the  IPS  as  part  of  the  AWOS 
incoming  message  log.  Analysis  of  the  LAD  messages  sent 
indicated: , 

minutes  1  -15,  17  -  31,  33  -  47,  49  -  63,  65  -  79,  and  81  - 
95:  flash  occurred  in  each  zone/sector  (NOTE:  Because  of  the 
numerical  rounding  some  border  line  cases  did  not  indicate  a 
flash  in  particular  zones  and  sectors.  See  PTRs  OTE-025,  OTE- 
026,  and  OTE-027) . 

minutes  95  —  111:  flash  occurred  in  zones  1  and  2. 

minutes  16,  32,  48,  64,  80,  96,  and  112:  no  flashes  occurred 
in  each  zone/sector. 

For  the  ITWS: 

The  LDD  messages  were  logged  on  the  IPS  for  each  ITWS  as  part  of 
their  incoming  message  log.  Analysis  of  the  ITWS's  LDD  messages 
indicated  that  each  of  the  lightning  flash  records  were  passed 
along,  since  each  flash  passed  the  rough  geographic  screening. 

As  a  result,  the  LDD  contained  for: 

minute  1,  17,  33,  49,  65,  81,  and  97  -  all  10  flash  records 
sent  by  NLDN  simulator.  ' 

For  this  test,  13  out  of  13  Evaluation  Criteria  passed.  The 
Evaluation  Criteria  used  to  determine  that  this  test's 
requirements  were  verified  are  contained  in  appendix  C. 
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4. 4. 1.5. 3  Results  and  Discussion. 

4. 4. 1.5. 3.1  Data. 

See  appendix  C  for  a  list  of  the  files  that  contain  the  test  data 
results  and  evaluation  criteria  Cross  Reference  (CR)  numbers 
indicated  in  the  Data  Reduction  and  Analysis  Method  section 
above . 

4. 4. 1.5. 3. 2  Significant  Problems. 

1.  During  OT&E  #1,  test  AL-02A,  there  were  a _ number  of  lightning 
strikes  that  were  not  reported  in  the  appropriate  LAD  messages. 
These  lightning  strikes  were  all  located  along  the  border  between 
different  zones/sectors.  DME  investigated  this  problem  and  found 
that  this  was  the  result  of  computer  rounding  errors.  This 
problem  was  classified  as  Major,  but  has  been  closed.  (Refer  to 
PTR  OTE-025,  OTE-026,  and  OTE-027.) 

4. 4. 1.5. 3. 3  PTRs  Generated.  . 

See  appendix  B  for  the  complete  PTR  details.  The  PTRs  generated 
with  respect  to  this  test  are: 

Major:  OTE-025  -  Closed 
OTE-02_6  -  Closed 
OTE-027  -  Closed 

4. 4. 1.6  TEST  AL-02B . 

The  objective  of  this  test  was  to  verify  particular  ALDARS  NAS- 
SS-1000  requirements  (see  appendix  A) . 

In  order  to  meet  these  objectives,  this  test  verified  that: 

a.  ADAS  could  process,  store,  and  maintain  a  database  to 
keep  track  of  AWOSs,  ASOSs,  and  ITWSs  that  were  enabled  to 
receive  NLDN  lightning  data. 

b.  ADAS  could  properly  determine  the  proximity  of  lightning 
strikes  and  generate  a  message  for  each  AWOS/ASOS  when  the 
lightning  strikes  were  within  the  defined  geographical  areas 
surrounding  the  AWOS/ASOS. 

c.  ADAS  maintained  the  status  of  lightning  activity- 
movement  and  identified  the  cessation  of  lightning  activity  for 
each  AWOS/ASOS. 

d.  ADAS  maintained  a  count  of  lightning  strikes  for  the 
last  15  minutes  for  each  of  the  10  zones/sectors  about  the . 
AWOS/ASOS  Airport  Reference  Point  (ARP)  [NOTE:  ADAS  maintained 
these  counts  internally  and,  therefore,  it  could  only  be 
determined  through  code  inspections.  Code  inspections  were 
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performed  at  DT&E  and  were  not  performed  during  OT&E.  However, 
ADAS  LAD  messages  maintained  a  15-minute  persistence  for 
lightning  activity  for  each  zone/sector.  This  capability  was 
verified  during  OT&E. ] 

e.  AWOS/ASOS  received  the  once  per  minute  LAD  data  sent  by 
ADAS  and  identified  thunderstorms  in  the  surface  observations  by 
reporting  it  when  the  lightning  was  presently  active. 

f.  AWOS/ASOS  correctly  reported  the  lightning  activity,  as 
defined  in  the  ADAS  LAD  message,  "at  the  airport"  when  the 
lightning  was  at  5  nmi  and  within  5  nmi  of  the  ARP. 

g.  AWOS/ASOS  correctly  reported  the  lightning  activity,  as 
defined  in  the  ADAS  LAD  message,  "in  vicinity  of  the  airport" 
when  the  lightning  occurred  within  a  ring  of  radius  greater  than 
5  nmi  and  less  than  or  equal  to  10  nmi  of  the  ARP. 

h.  AWOS/ASOS  correctly  reported  the  appropriate  sector 
directional  designator  for  the  lightning  activity,  as  defined  in 
the  ADAS  LAD  message,  when  lightning  was  between  10  and  30  nmi  of 
the  ARP. 

4. 4. 1.6.1.  Description. 

This  scenario  involved  one  live  AWOS,  one  live  ASOS,  and  one 
simulated  AWOS.  The  two  live  stations  replicated- the  simulated 
station  with  the  same  latitude  and  longitudes  (Note:  The  ADAS 
does  not  allow  them  to  be  exactly  the  same,  therefore,  the 
latitudes  were  off  by  .05  minutes.)  As  a  result,  the  log  files 
for  the  simulated  station  were  used  to  verify  the  data  sent  to 
the  live  stations.  The  live  AWOS  and  ASOS  were  necessary  to 
verify  that  the  AWOS  and  ASOS  properly  encoded  the  LAD  messages 
sent  by  ADAS.  The  IPS  sent  the  same  flash  messages  for  all. 
sites.  This  entailed  single  strikes  in  multiple  zones  and 
sectors,  in  various  combinations,  to  ensure  that  ADAS  generated 
the  appropriate  LAD  messages.  Determination  was  made  that  the 
live  AWOS  and  ASOS  properly  reported  the  correct  messages. 

The  following  is  a  description  of  the  scenario  that  was  performed 
for  the  AWOSs  and  the  ASOSs.  The  IPS  was  scripted  using  the 
Standard  and  Specified  Flash  Message  and  designed  with  a  delay  to 
allow  for  initialization.  The  script  generated  combinations  of 
flashes  in  order  that  processing  could  be  performed  for  multiple 
strikes . 

4. 4. 1.6. 2  Data  Reduction  and  Analysis  Method. 

NOTE:  Actual  analysis  may  find  that  some  messages  do  not  occur 
at  the  minutes  indicated  below.  This  is  the  result  of  the  delay 
of  the  IPS  sending  out  LDD  messages  as  the  script  progresses 
through  its  life  cycle.  The  following  is  a  description  as  to  why 
this  occurs. 
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At  the  beginning  of  the  script,  the  LDD  flash  messages  are  sent 
to  ADAS  at  the  beginning  of  the  minute  or  mission  cycle.  As  the 
script  progresses,  the  LDD  flash  messages  experience  a  delay  m 
being  sent  to  ADAS  and,  therefore,  are  sent  to  ADAS  later  and 
later  into  the  minute/mission  cycle.  As  a  result,  when  the 
script  first  starts,  the  LDD  messages  sent  at  the  top  of  the 
minutes  get  processed  by  ADAS  during  that  minute's  mission  cycle. 
But  at  some  point  during  the  life  of  the  script,  the  LDD  message 
will  be  sent  to  ADAS  too  late  into  the  mission  cycle  and  as  a 
result  will  not  get  processed  during  that  minute's  mission  cycle. 
When  this  occurs  the  LDD  message  will  not  get  processed  until  the 
next  minute's  mission  cycle  and,  therefore,  it  appears  as  if  ADAS 
"skipped"  processing  LDD  messages  for  1  minute. 

LAD  messages: 

Configuration  66  was  set  up  for  the  live  AWOS  and  ASOS  to  have  a 
corresponding  AWOS  simulator.  As  a  result,  the  LAD  messages  were 
logged  on  the  IPS  as  part  of  the  AWOS  incoming  message  log. 

These  logged  messages  were  used  to  verify  that  the  messages  for 
the  live  AWOS  and  ASOS  were  correct. 

Analysis  of  the  LAD  messages  sent  verified  the  following: 

minutes  1  and  2  -  lightning  in  zone  1  and  sector  7 

minutes  3  and  4  -  lightning  in  zone  1  and  sectors  6  and  / 

minutes  5  to  15  -  lightning  in  zone  1  and  sectors  5,  6, 

and  Minutes  16  and  17  -  lightning  in  zone  1  and  sectors  5  and  6 

minutes  18  and  19  -  lightning  in  zone  1  and  sectors  4,  b, 

minutes  20  to  32  -  lightning  in  zone  1  and  sectors  2,  4, 

minutes  33  and  34  -  lightning  in  zone  1  and  sectors  2,  3,  4, 

and  5  .  .  _  . 

minutes  35  to  47  -  lightning  in  zone  2  and  sectors  1,  3,  4, 

minutes  48  and  49  -  lightning  in  zone  2  and  sectors  1,  2,  4, 

minutes  50  to  62  -  lightning  in  zone  2  and  sectors  2,  4,  5, 

and  8  .  „  ,  ,  .  a 

minutes  63  and  64  _  lightning  in  zone  2  and  sectors  1,  3,  d, 

7,  and  8  ,  ,  -  , 

minutes  65  to  77  -  lightning  m  zone  2  and  sectors  1,  3,  6, 

and  7 

minute  78  to  92  -  lightning  in  zone  2  and  sector  3 
minute  93  -  no  lightning  occurred. 
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SPECIs  at: 

minutes  1,  6,  21,  36,  51,  81 
For  the  live  AWOS/ASOS: 

Determination  that  the  live  AWOS  and  ASOS  correctly  incorporated 
the  LAD  messages  was  done  through  inspection  of  the  1-minute  AWOS 
format  messages  that  ADAS  received  from  the  AWOS  and  ASOS.  This 
information  was  found  in  the  DLP  file  which  contained  the  AWOS 
format  1-minute  messages.  Below  is  a  description  of  what  was 
included  in  the  AWOS/ASOS  1-minute  messages. 

The  DLP  file  was  logged  on  the  IPS.  Analysis  of  the  DLP  file 
indicated  that  flashes  occurred  as  follows: 

minutes  2  and  3  -  lightning  "AT  THE  AIRPORT"  and  "LTG  DSNT 
W" 

minutes  4  to  5  -  lightning  "AT  THE  AIRPORT"  and  "LTG  DSNT  SW 
&  W" 

minutes  6  to  16  -  lightning  "AT  THE  AIRPORT"  and  "LTG  DSNT  S 
-  W" 

minutes  17  and  18  -  lightning  "AT  THE  AIRPORT"  and  "LTG  DSNT 
S  &  SW" 

minutes  19  and  20  -  lightning  "AT  THE  AIRPORT"  and  "LTG  DSNT 
SE  -  W" 

minutes  21  to  33  -  lightning  "AT  THE  AIRPORT"  and  "LTG  DSNT 
NE  &  SE  &  W" 

minutes  34  and  35  -  lightning  "AT  THE  AIRPORT"  and  "LTG  DSNT 
NE  -  S" 

minutes  36  to  48  -  lightning  "VICINITY",  and  "LTG  DSNT  ALQDS " 
(Id  hex) . 

minutes  49  and  50  -  lightning  "VICINITY"  and  "LTG  DSNT 
ALQDS"  (lb  hex) 

minutes  51  to  63  -  lightning  "VICINITY"  and  "LTG  DSNT  ALQDS" 
(9a  hex) 

minutes  64  and  65  -  lightning  "VICINITY"  and  "LTG  DSNT 
ALQDS"  (e5  hex) 

minutes  66  to  78  -  lightning  "VICINITY"  and  "LTG  DSNT  ALQDS" 
(65  hex) 

minute  79  to  93  -  lightning  "VICINITY"  and  "LTG  DSNT  E" 
minute  94  -  no  lightning  occurred . 

SPECI  bit: 

minutes  2,  7,  22,  37,  52,  82 

Also,  starting  at  minute  2  there  was  an  Automated  Remark,  TSBxx, 
to  indicate  the  beginning  of  the  thunderstorm.  This  remark  was 
maintained  until  the  next  hour  was  reached.  Once  the  hour  was 
reached,  the  TSBxx  was  dropped.  No  TSExx  was  recorded  since  the 
test  ended  before  it  was  generated. 
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For  the  ITWS: 

The  LDD  messages  was  logged  on  the  IPS  for  each  ITWS  as  part  of 
their  incoming  message  log.  Analysis  of  the  ITWS's  LDD  messages 
indicated  that  each  of  the  lightning  flash  records  had  been 
passed  along  (since  each  flash  passed  the  rough _ geographic 
screening) .  Inspection  of  the  LDD  messages  verified  the 
following:  . 


minute  1  -  flash  for  zone  1  and  sector  7. 

minute  3  -  flash  for  zone  1  and  sector  6. 

minute  5  -  flash  for  zone  1  and  sector  5, 

minute  18  -  flash  for  zone  1  and  sectors  4  and  7. 

minute  20  -  flash  for  zone  1  and  sector  2. 

minute  33  -  flash  for  sectors  3,  4,  and  5. 

minute  35  -  flash  for  zone  2  and  sector  1, 

minute  48  -  flash  for  zone  2  and  sector  2,  4,  and  5. 

minute  50  -  flash  for  zone  2  and  sector  8 . 

minute  63  -  flash  for  zone  2  and  sectors  1,  3,  6,  and  7. 

minute  78  -  flash  for  zone  2  and  sector  3 . 

For  this  test,  36  out  of  37  Evaluation  Criteria  fully  passed  and 
1  out  of  37  Evaluation  Criteria  partially  passed.  The  Evaluation 
Criteria  used  to  determine  that  this  test's  requirements  were 
verified  are  contained  in  appendix  C. 

4. 4. 1.6. 3  Results  and  Discussion. 

4. 4. 1.6. 3.1.  Data . 

See  appendix  C  for  a  list  of  the  files  that  contain  the  test  data 
results  and  evaluation  criteria  CR  numbers  indicated  in  the  Data 
Reduction  and  Analysis  Method  section  above. 

4. 4. 1.6. 3. 2  Significant  Problems. 

a.  AWOS  related  problems 

1.  During  OT&E  #1,  analysis  of  the  live  AWOS  test  data 
that  the  One- Minute  Observation  (OMO)  messages  did  not 
have  the  Thunderstorm  Begin  and  Thunderstorm  End  Alert  Data  bits 
set  under  certain  conditions.  AUA-430  researched  this  problem 
and  found  that  there  was  no  requirement  for  the  AWOS  to  set  these 
bits,  even  though  the  bits  are  available  in  the  OMO  messages. 
ACT-320  recommended  that  a  note  be  placed  in  the  ICD  for  AWOS  to 
set  these  bits.  AUA-430  elected  to  leave  the  ICD  as  is.  Since 
there  was  no  requirement  for  AWOS  to  set  these  bits,  this  PTR  was 
closed.  This  problem  was  classified  as  Moderate.  (Refer  to  PTR 
OTE-036) . 
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b.  ASOS-related  problems 

1.  Live  testing  with  the  ASOS  revealed  that  "THROUGH" 

was  used  in  place  of  in  the  LTG  DSNT  ..."  remarks.  The  ASOS 

software  was  modified  and  testing  verified  that  the  problem  was 
corrected.  As  a  result,  this  problem  was  closed.  This  problem 
was  classified  as  Minor.  (Refer  to  PTR  OTE-035) . 

2.  During  OT&E  #2,  analysis  of  the  data  for  test  AL-02B 
(file  al-02b-2 .cap)  revealed  that  the  ASOS,  KSP1,  had  the 
following  problems: 

(a)  multiple  Thunderstorm  Begin  (TSB)xx  remarks 
without  any  Exx  imbedded  in  the  message. 

(b)  cases  where  the  minutes  crossed  over  from  1 
hour  to  the  next  and  the  TSB  remark  did  not  indicate  the  previous 
hour;  i.e.,  TSBhhxx. 

(c)  some  of  the  TSBxx  minutes  changed  from  one 
SPECI  to  the  next  SPECI;  e.g.,  in  one  SPECI  TSB12  would  be 
indicated  and  in  the  next  TSB17  would  appear. 

These  problems  were  classified  as  Major  and  remain  open.  (Refer 
to  PTR  OTE-054. ) 

4. 4. 1.6. 3. 3  PTRS  GENERATED. 

See  appendix  B  for  the  complete  PTR  details.  The  PTRs  generated 
with  respect  to  this  test  are: 

‘  ...  .  .  •  i,  '  .  .  ... 

Major:  OTE-054  -  Open 

Moderate:  OTE-056  -  Closed 

Minor:  OTE-035  -  Closed 

OTE-036  -  Closed 

4 .4 .1 .7  Test  AL-02C . 

The  objective  of  this  test  was  to  verify  particular  ALDARS  NAS- 
SS-1000  requirements  (see  appendix  A). 

In  order  to  meet  this  objective,  this  test  verified  that: 

a.  ADAS  could  process,  store,  and  maintain  a  database  to 
keep  track  of  AWOSs,  ASOSs,  and  ITWSs  that  were  enabled  to 
receive  NLDN  lightning  data. 

b.  ADAS  properly  determined  the  proximity  of  lightning 

strikes  and  generated  a  message  for  each  AWOS/ASOS  when  the 
lightning  strikes  were  within  the  defined  geographical  areas 
surrounding  the  AWOS/ASOS.  ' 
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c.  ADAS  maintained  the  status  of  lightning  activity 
movement  and  identified  the  cessation  of  lightning  activity  for 
each  AWOS/ASOS. 

d.  ADAS  maintained  a  count  of  lightning  strikes  for  the 
last  15  minutes  for  each  of  the  10  zones/sectors  about  the 
AWOS/ASOS  ARP.  [NOTE:  ADAS  maintained  these  counts  internally 
and,  therefore,  it  could  only  be  determined  through  code 
inspections.  Code  inspections  were  performed  at  DT&E  and  were 
not  performed  during  OT&E.  However,  ADAS  LAD  messages  do 
maintain  a  15-minute  persistence  for  lightning  activity  for  each 
zone/sector.  This  capability  was  verified  during  OT&E.] 

e.  AWOS/ASOS  received  the  once  per  minute  LAD  data  sent  by 
ADAS  and  identified  thunderstorms  in  the  surface  observations  by 
reporting  it  when  the  lightning  was  presently  active. 

f.  AWOS/ASOS  correctly  reported  the  lightning  activity,  as 
defined  in  the  ADAS  LAD  message,  "at  the  airport"  when  the 
lightning  was  within  5  nmi  and  within  5  nmi  of  the  ARP. 

g.  AWOS/ASOS  correctly  reported  the  lightning  activity,  as 
defined  in  the  ADAS  LAD  message,  "in  vicinity  of  the  airport" 
when  the  lightning  was  from  5  nmi  to  10  nmi  of  the  ARP. 

h.  AWOS/ASOS  correctly  reported  the  appropriate  sector 
directional  designator  for  the  lightning  activity,  as  defined  in 
the  ADAS  LAD  message,  when  lightning  was  between  10  and  30  nmi  of 
the  ARP. 

4. 4. 1.7,1  Description . 

This  scenario  involved  one  live  AWOS,  one  live  ASOS,  and  one 
simulated  AWOS.  The  two  live  stations  replicated  the  simulated 
station  with  the  same  latitude  and  longitudes.  (Note:  The  ADAS 
does  not  allow  them  to  be  exactly  the  same,  therefore,  the 
latitudes  were  off  by  .05  minutes.)  As  a  result,  the  log  files 
for  the  simulated  station  were  used  to  verify  the  data  sent  to 
the  live  stations.  The  live  AWOS  and  ASOS  were  necessary  to 
verify  that  the  AWOS  and  ASOS  properly  encoded  LAD  messages  sent 
by  ADAS.  The  IPS  sent  the  same  flash  messages  for  all  sites. 

The  flash  messages  entailed  single  strikes  in  zones  and  sectors, 
in  a  zone  by  zone,  sector  by  sector  process,  to  ensure  that  ADAS 
generated  the  appropriate  LAD  messages.  This  enabled  the 
determination  that  the  live  AWOS  and  ASOS  properly  reported  the 
correct  message. 

This  scenario  was  designed  in  order  that  the  IPS  sent  a  flash 
record  every  16  minutes  that  fell  into  one  of  the  10  possible 
AWOS  zones/sectors.  These  flash  messages  were  generated  every  16 
minutes  to  allow  for  the  15-minute  persistence  to  clear  out  the 
LAD  messages.  As  a  result,  for  a  given  15-minute  period  only  one 
zone/sector  was  active. 
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The  IPS  was  scripted  using  the  Standard  and  Specified  Flash 
Message.  Flash  messages  contained  one  flash  for  one  of  the  10 
zones/sectors . 

4.4. 1.7.2  Data  Reduction  and  Analysis  Method. 

NOTE:  Actual  analysis  may  find  that  some  messages  do  not  occur  at 
the  minutes  indicated  below.  This  is  the  result  of  the  delay  of 
the  IPS  sending  out  LDD  messages  as  the  script  progresses  through 
its  life  cycle.  The  following  is  a  description  as  to  why  this, 
occurs.  ■ 

At  the  beginning  of  the  script,  the  LDD  flash  messages  are  sent 
to  ADAS  at  the  beginning  of  the  minute  or  mission  cycle.  As  the 
script  progresses,  the  LDD  flash  messages  experience  a  delay  in 
being  sent  to  ADAS  and,  therefore,  are  sent  to  ADAS  later  and 
later  into  the  minute/mission  cycle.  As  a  result,  when  the 
script  first  starts,  the  LDD  messages  sent  at  the  top  of  the 
minutes  get  processed  by  ADAS  during  that  minute's  mission  cycle. 
But  at  some  point  during  the  life  of  the  script,  the  LDD  message 
will  be  sent  to  ADAS  too  late  into  the  mission  cycle  and  as  a 
result  will  not  get  processed  during  that  minute's  mission  cycle. 
When  this  occurs  the  LDD  message  Will  not  get  processed  until  the 
next  minute's  mission  cycle  and,  therefore,  it  appears  as  if  ADAS 
"skipped"  processing  LDD  messages  for  1  minute. 

LAD  messages: 

The  LAD  messages  were  logged  on  the  IPS  as  part  of  the  AWOS 
incoming  message  log.  Analysis  of  the  LAD  messages  sent 
indicated  that  a  flash  occurred  as  follows: 

minutes  1  -  15,  zone  1 
minutes  17  -  31,  zone  2 
minutes  33  -  47,  sector  1 
minutes  49  -  63,  sector  2 
minutes  65  -  79,  sector  3 
minutes  81  -  95,  sector  4 
minutes  97  -  111,  sector  5 
minutes  113  -  127,  sector  6 
minutes  129  -  143,  sector  7 
minutes  145  -  159,  sector  8 

During  minutes  16,  32,  48,  64,  80,  96,  112,  128,  144,  and  160, 
the  LAD  indicated  that  no  flashes  occurred  in  each  zone/sector. 

For  the  live  AWOS/ASQS: 

Determination  that  the  live  AWOS  and  ASOS  correctly  incorporated 
the  LAD  messages  was  done  through  inspection  of  the  1 -minute  AWOS 
format  messages  that  ADAS  received  from  the  AWOS  and  ASOS.  This 
information  was  found  in  the  DLP  file  which  contained  the  AWOS 
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format  1-minute  messages.  Also,  the  METAR/SPECI  messages  that 
ASOS  sent  and  ADAS  generated  (for  AWOS)  were  inspected  using  the 
WMSCR  file.  Below  is  a  description  of  what  was  included  in  the 
AWOS/ASOS  1-minute  messages.. 

The  DLP  file  was  logged  on  the  IPS.  Analysis  of  the  DLP  file 
indicated  that  a  flash  occurred  as  follows: 

minutes  2  -  16,  indicated  lightning  at  the  airport 
minutes  18  -  32,  indicated  lightning  in  vicinity  of  airport 
minutes  34  -  48,  indicated  lightning  in  the  N  sector 

minutes  50  -  64,  indicated  lightning  in  the  NE  sector 

minutes  66  -  80,  indicated  lightning  in  the  E  sector 

minutes  82  -  96,  indicated  lightning  in  the  SE  sector 

minutes  98  -  112,  indicated  lightning  in  the  S  sector 
minutes  114  -  128,  indicated  lightning  in  the  SW  sector 

minutes  130  -  144,  indicated  lightning  in  the  W  sector 

minutes  146  -  160,  indicated  lightning  in  the  NW  sector 

During  minutes  17,  33,  49,  65,  81,  97,  113,  129,  145,  and  161, 

the  DLP  indicated  that  no  flashes  occurred  in  each  zone/sector. 

The  WMSCR  file  was  logged  on  the  IPS.  Analysis  of  the  WMSCR  file 
indicated  that  a  SPECI  was  generated  for  the  following  times  with 
flashes  as  follows: 

minutes  2,  indicated  lightning  at  the  airport 
minutes  18,  indicated  lightning  in  vicinity  of  airport 
minutes  34,  indicated  lightning  in  the  N  sector 

minutes  50,  indicated  lightning  in  the  NE  sector 

minutes  66,  indicated  lightning  in  the  E  sector 

minutes  82,  indicated  lightning  in  the  SE  sector 

minutes  98,  indicated  lightning  in  the  S  sector 

minutes  114,  indicated  lightning  in  the  SW  sector 

minutes  130,  indicated  lightning  in  the  W  sector 

minutes  146,  indicated  lightning  in  the  NW  sector 

For  this  test,  34  out  of  36  Evaluation  Criteria  fully  passed  and 

2  out  of  36  Evaluation  Criteria  partially  passed  .  The 
Evaluation  Criteria  used  to  determine  that  this  test's 
requirements  were  verified  are  contained  in  appendix  C. 

4. 4. 1.7. 3  Results  and  Discussion. 

4 . 4 . 1 . 7 . 3 . 1  Data . 

See  appendix  C  for  a  list  of  the  files  that  contain  the  test  data 
results  and  evaluation  criteria  CR  numbers  indicated  in  the  Data 
Reduction  and  Analysis  Method  section  above. 


29 


4. 4. 1.7. 3. 2  Significant  Problems. 

a.  ASOS-related  problems 

1.  During  live  testing  with  the  ASOS, . it  was  discovered 
that  the  ASOS  incorporated  15  minutes  of  persistence  in  addition 
to  that  of  the  ADAS  15-minute  persistence  on  each  lightning 
strike.  This  problem  was  corrected,  retested,  and  verified  to  be 
resolved  (see  OT&E  #1  data  file  al-02c-4 . cap) .  (Refer  to  PTR 
OTE-028 . ) 

2.  During  the  retest  of  problem  A.I.,  above,  it  was 
discovered  that  ASOS  sent  "LTG  DATA  MISG"  remarks  whenever  the 
ASOS  did  not  receive  the  ADAS  LAD  message  in  time  for  the  ASOS 
0M0  processing  cycle.  Retesting  has  been  performed  a  number  of 
times  and  still  exists.  This  problem  was  classified  as  Major. 
(Refer  to  PTR  OTE-037.) 

b.  Other  Problems 

1.  The  ASOS  and  AWOS  systems  handled  differently  the 
TSB/TSE  for  lightning  strikes  for  zone  3.  ASOS  did  not  generate 
TSB/TSE  remarks  for  zone  3  and  AWOS  did.  The  proposed  resolution 
of  this  problem  will  be  for  AUA  to  update  the  ICD  in  order  that 
AWOS  does  not  issue  TSB/TSE  for  zone  3  strikes.  The  contractor, 
DME,  will  be  instructed  to  make  this  software  change  for  the  Y2K 
software  build.  This  problem  is  classified  as  Moderate.  (Refer 
to  PTR  OTE-029.  ) 

c.  ADAS-related  problems 

1.  Automated  Lightning  Remarks.  ADAS  did  not  include 
LTG  AT  AIRPORT  and  LTG  VCNTY  remarks  into  the  LAD  message.  As  a 
result,  these  remarks  are  not  incorporated  into  the  AWOS  and  ASOS 
0M0,  SPECI,  and/or  METAR  messages.  The  ADAS  Specification 
indicates  that  these  should  not  be  in  the  LAD,  but  the  ADAS/AWOS 
ICD  indicates  that  these  remarks  should  be  in  the  LAD.  The 
proposed  resolution  is  that  AUA  will  update  the  ICD  to  explicitly 
state  that  LTG  AT  AIRPORT  and  LTG  VCNTY  not  be  included  in  the 
remarks.  This  change  has  not  been  made  yet  and,  therefore,  this 
PTR  remains  open.  This  problem  is  classified  as  Moderate. 

(Refer  to  PTR  OTE-009.) 

2.  Thunderstorm  Begin/End  errors  with  Metars  Messages. 

(a)  During  OT&E  #1,  it  was  discovered  that  octets 
57/58  were  not  used  properly  by  ADAS  as  the  source  data  for 
TSB/TSE  remarks  in  METAR  messages .  Also,  ADAS  did  not 
incorporate  TSE  remarks  when  the  associated  TSB  was  generated  in 
the  hour  prior  to  the  TSE.  These  two  problems  were  related  and 
classified  as  Major.  (Refer  to  PTRs  OTE-OIO  and  OTE-032.)  Both 
of  these  problems  were  verified  as  corrected  during  OT&E  #2  and 
the  PTRs  were  closed.  However,  during  the  retesting  of  these 
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problems,  a  new  problem  was  discovered.  This  new  PTR  was 
documented  in  PTR  OTE-052  (see  2.c  below). 


(b)  During  OT&E  #1,  it  was  discovered  that  the  time 
stamp  used  for. the  ADAS-generated  SPECIs  differed  from  the  time 
stamp  of  the  TSB/TSE  contained  in  the  message.  This  problem  was 
classified  as  Critical  since  the  credibility  of  the  information 
would  be  questioned  by  the  users.  During  OT&E  #2,  this  problem 
was  verified  as  corrected  and  the  PTR  was  closed.  (Refer  to  PTR 
OTE-012.) 


(c)  During  the  retesting  of  PTRs  OTE-010  and  OTE- 
032,  it  was  discovered  (in  the  al-02c-l  data)  that  every  OTIS 
SPECI  within  a  given  hour  that  contained  more  than  one  TSBxx  and 
ended  the  Thunderstorm  portion  of  the  present  weather  begin/end 
remark  field  with  a  Bxx,  did  not  contain  the  first  TSExx  that 
occurred  during  that  hour.  This  problems  was  classified  as 
Moderate  and  remained  open.  (Refer  to  PTR  OTE-052.) 


4. 4. 1.7. 3. 3  PTRs  Generated. 

See  appendix  B  for  the  complete  PTR  details.  The  PTRs  generated 
with  respect  to  this  test  are: 

Critical:  OTE-028  -  Closed 


Major:  OTE-010  -  Closed 

OTE-032  -  Closed 

OTE-037  -  Open 


Moderate:  OTE-009  -  Open 

OTE-021  -  Closed 
OTE-029  -  Open 
OTE-052  -  Open 


4. 4. 1.8  Test  AL-03 . 

The  objective  of  this  test  was  to  verify  particular  ALDARS  NAS 
SS-1000  requirements  (see  appendix  A) . 

In  order  to  meet  this  objective,  this  test  verified  that: 

a.  ADAS  could  process,  store,  and  maintain  a  database  to 
keep  track  of  AWOSs,  ASOSs,  and  ITWSs  that  were  enabled  to 
receive  NLDN  lightning  data. 

b.  ADAS  properly  determined  the  proximity  of  lightning 
strikes  and  generated  a  message  for  each  AWOS/ASOS ^ when  the 
lightning  strikes  were  within  the  defined  geographical  areas 
surrounding  the  AWOS/ASOS. 

c.  ADAS  maintained  status  of  lightning  activity  movement. 
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d.  ADAS  maintained  a  count  of  lightning  strikes  for  the 
last  15  minutes  for  each  of  the  10  zones/sectors  about  the 
AWOS/ASOS  ARP  [NOTE:  ADAS  maintained  these  counts  internally  and, 
therefore,  it  could  only  be  determined  through  code  inspections. 
Code  inspections  were  performed  at  DT&E  jand  were  not  performed 
during  OT&E.  However,  ADAS  LAD  messages  did  maintain  a  15-minute 
persistence  for  lightning  activity  for  each  zone/sector.  This 
capability  was  verified  during  OT&E.] 

4. 4. 1.8.1  Description. 

This  scenario  involved  four  simulated  AWOSs.  The  four  AWOSs  were 
placed  in  a  rectangular  pattern  and  all  four  were  fully  inside 
the  ADAS  boundaries.  AWOSs  1,  2,  and  3  were  all  to  be  LAD 
message  enabled,  but  AWOS  4  was  not. 

During  initialization,  the  IPS  was  set  up  to  send  out  Null 
flashes.  This  continued  until  the  ADAS  and  IPS  established 
communications  and  the  test  operator  initiated  the  start  of  the 
al-03  lightning  script.  Theh,  at  minute  1,  flash  messages  were 
sent  which  contained  lightning  strikes  just  outside  the  30  nmi 
limit  for  AWOS  1  and  2.  For  minutes  2  through  6,  the  lightning 
strikes  proceeded  northward,  with  a  single  lightning  strike 
falling  in  the  adjacent  zone  to  the  north  for  AWOS  1  and  2.  At 
minute  7,  a  lightning  strike  fell  half  way  between  AWOSs  2  and  3 
and  half  way  between  AWOSs  1  and  4.  For  minutes  8  through  12, 
the  lightning  strikes  continued  to  proceed  northward,  with  a 
single  lightning  strike  falling  in  the  adjacent  zone  to  the  north 
for  AWOS  3  and  4.  Since  AWOS  4  was  LAD  message  disabled,  no  LAD 
messages  were  sent  to  this  AWOS.  At  minute  13,  a  lightning 
strike  fell  just  to  the  north  of  the  30  nmi  boundary  for  AWOS  3 
and  4.  Also,  during  minutes  1  through  13  for  each  minute,  62 
lightning  strikes  fell  outside  the  30  nmi  boundaries  of  the  AWOSs 
but  within  the  ARTCC  boundary.  Additionally,  for  each  minute,  62 
lightning  strikes  fell  outside  of  the  ARTCC  boundary,  but  within 
the  continental  United  States  (CONUS). 

A  final  minute  of  Null  flashes  was  sent  so  that  the  test  did  not 
terminate  before  the  13th-minute 's  lightning  was  processed. 

4. 4. 1.8. 2  Data  Reduction  and  Analysis  Method. 

NOTE:  Actual  analysis  may  find  that  some  messages  do  not  occur 
at  the  minutes  indicated  below.  This  is  the  result  of  the  delay 
of  the  IPS  sending  out  LDD  messages  as  the  script  progresses 
through  its  life  cycle.  The  following  is  a  description  as  to  why 
this  occurs . 

At  the  beginning  of  the  script,  the  LDD  flash  messages  are  sent 
to  ADAS  at  the  beginning  of  the  minute  or  mission  cycle.  As  the 
script  progresses,  the  LDD  flash  messages  experience  a  delay  in 
being  sent  to  ADAS  and,  therefore,  are  sent  to  ADAS  later  and 
later  into  the  minute/mission  cycle.  As  a  result,  when  the 
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script  first  starts,  the  LDD  messages  sent  at  the  top  of  the 
minutes  get  processed  by  ADAS  during  that  minute's  mission  cycle. 
But  at  some  point  during  the  life  of  the  script,  the  LDD  message 
will  be  sent  to  ADAS  too  late  into  the  mission  cycle  and  as  a 
result  will  not  get  processed  during  that  minute's  mission  cycle. 
When  this  occurs  the  LDD  message  will  not  get  processed  until  the 
next  minute's  mission  cycle  and,  therefore,  it  appears  as  if  ADAS 
" skipped"  processing  LDD  messages  for  1  minute. 

AWOS  LAD  messages: 

The  LAD  messages  were  logged  on  the  IPS  as  part  of  the  AWOS 
incoming  message  log.  The  following  was  the  analysis  of  the  LAD 
messages  sent : 

At  minute  2,  the  LAD  message  indicated  no  flashes  for  any  of  the 
AWOSs. 

At  minute  3,  the  LAD  message  indicated  a  flash  for  sector  b  for 

AWOS  1  and  2.  ' 

At  minute  4,  the  LAD  message  indicated  a  flash  for  zone  2  and 

sector  5  for  AWOS  1  and  2 . 

At  minute  5,  the  LAD  message  indicated  a  flash  for  zone  1,  zone 
2,  and  sector  5  for  AWOS  1  and  2. 

At  minute  6,  the  LAD  message  indicated  a  flash  for  zone  1,  zone 
2,  and  sector  5  for  AWOS  1  and  2. 

At  minute  7,  the  LAD  message  indicated  a  flash  for  zone  1,  zone 
2,  and  sectors  1  and  5  for  AWOS  1  and  2. 

At  minute  8,  the  LAD  message  indicated  a  flash  for  zone  1,  zone 
2,  and  sectors  1  and  5  for  AWOS  1  and  2. 

At  minute  9,  the  LAD  message  indicated  a  flash  for  zone  1,  zone 

2,  and  sectors  1  and  5  for  AWOS  1  and  2  and  for  sector  5  for  AWOS 

3.  ■  ■ 

At  minute  10,  the  LAD  message  indicated  a  flash  for  zone  1,  zone 
2,  and  sectors  1  and  5  for  AWOS  1  and  2  and  for  zone  2  and  sector 
5  for  AWOS  3. 

At  minute  11,  the  LAD  message  indicated  a  flash  for  zone  1,  zone 
2,  and  sectors  1  and  5  for  AWOS  1  and  2  and  for  zone  1,  zone  2, 
and  sector  5  for  AWOS  3. 

At  minute  12,  the  LAD  message  indicated  a  flash  for  zone  1,  zone 
2,  and  sectors  1  and  5  for  AWOS  1  and  2  and  for  zone  1,  zone  2, 
and  sector  5  for  AWOS  3. 

At  minute  13,  the  LAD  message  indicated  a  flash  for  zone  1,  zone 
2,  and  sectors  1  and  5  for  AWOS  1,  2,  and  3. 

At  minute  14,  the  LAD  message  indicated  a  flash  for  zone  1,  zone 
2,  and  sectors  1  and  5  for  AWOS  1,  2,  and  3. 

Since  AWOS  4  was  LAD  message  disabled,  no  flash  messages  were 
sent  to  this  AWOS.  .  v 

ITWS  LDD  messages: 

The  LDD  messages  were  logged  on  the  IPS  for  each  ITWS  as  part  of 
their  incoming  message  log.  Analysis  of  the  ITWS's  LDD  messages 
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for  each  minute  indicated  that  only  those  lightning  strikes  that 
passed  rough  geographical  screening  (i.e.,  the  62  strikes  that 
fell  within  the  ADAS  boundaries  and  the  flashes  that  fell  within 
30  nmi  of  the  3  AWOSs)  were  passed  along. 

For  this  test,  12  out  of  12  Evaluation  Criteria  passed.  The 
Evaluation  Criteria  used  to  determine  that  this  test's 
requirements  were  verified  are  contained  in  appendix  C. 

4. 4. 1.8. 3  Results  and  Discussion. 

4 . 4 . 1 . 8 . 3 . 1  Data . 

See  appendix  C  for  a  list  of  the  files  that  contain  the  test  data 
results  and  evaluation  criteria  CR  numbers  indicated  in  the  Data 
Reduction  and  Analysis  Method  section  above. 

4. 4. 1.8. 3. 2  Significant  Problems . 

None 

4. 4. 1.8. 3. 3  PTRs  Generated. 

See  appendix  B  for  the  complete  PTR  details.  The  PTR  generated 
with  respect  to  this  test  was: 

Moderate:  OTE-002  -  Closed 

4. 4, 1.9  Test  AL-04. 

The  objective  of  this  test  is  to  verify  that  the  ADAS  properly 
processes  LDD  data  containing  lightning  flashes  that  fall  in  an 
area  of  geographic  overlap  for  three  AWOSs  and  to  verify 
particular  ALDARS  NAS-SS-1000  requirements  (see  appendix  A). 

In  order  to  meet  this  objective,  this  test  will  verify  that: 

a.  ADAS  can  process  NLDN  data. 

ADAS  can  properly  determine  the  proximity  of  lightning  strikes 
and  generate  a  message  for  each  AWOS/ASOS  when  the  lightning 
strikes  are  within  the  defined  geographical  areas  surrounding  the 
AWOS/ASOS. 

4. 4. 1.9.1  Description . 

An  IPS-driven  test  was  configured  to  include  three  AWOSs  located 
such  as  to  ensure  that  the  AWOSs  overlapped.  The  AWOSs  were 
located  such  that  they  all  had  the  same  longitude.  The  one  AWOS 
(simulator  #5)  was  located  exactly  40  nmi  from  the  other  two 
AWOSs  (simulators  #1  and  #2) .  Hence,  the  west  sector  of  east 
most  AWOS  simulator  (#1)  overlapped  the  east  sector  of  the  middle 
AWOS  simulator  (#5)  by  10  nmi.  The  east  sector  of  the  west  most 
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AWOS  simulator  (#2)  overlapped  the  west  sector  of  the  middle  AWOS 
simulator  by  10  nmi .  The  NLDN  simulator  sent  LDD  data  with  two 
flash  records  for  1  minute  to  ADAS.  One  of  these  lightning 
strikes  "fell"  in  the  overlapping  east  sector  of  simulator  #2  and 
west  sector  of  simulator  #5.  The  other  lightning  strike  fell 
in  the  overlapping  west  sector  of  simulator  #1  and  the  east 
sector  of  simulator  #5.  A  second  minute  of  Null  flashes  was  sent 
so  that  the  test  did  not  terminate  before  the  first-minute  s 
lightning  was  processed. 

4. 4. 1.9. 2  Data  Reduction  and  Analysis  Method. 

The  NLDN  LDD  file  was  analyzed  to  determine  that  the  lightning 
data  was  sent  at  the  test  commencement  minute  recorded  in  the 
test  procedures. 

The  LAD  messages  were  logged  on  the  IPS  as  part  of  the  AWOS 
incoming  message  log.  Analysis  of  the  LAD  messages  sent  for  the 
first  minute  (corresponding  to  the  time  recorded  in  the  test 
procedure  steps  and  the  NLDN  LDD  file)  indicated  that  a  flash 
occurred  in  the  W  sector  for  AWOS  simulator  #1,  in  the  E  sector 
for  AWOS  simulator  #2,  and  the  E  and  W  sector  for  AWOS  simulator 

#5. 

For  this  test,  four  out  of  four  Evaluation  Criteria  passed.  The 
Evaluation  Criteria  used  to  determine  that  .  this  test  s 
requirements  were  verified  are  contained  in  appendix  C. 

4. 4. 1.9. 3  Results  and  Discussion. 

4 . 4 . 1 . 9 . 3 . 1  Data . 

See  appendix  C  for  a  list  of  the  files  that  contain  the  test  data 
results  and  evaluation  criteria  CR  numbers  indicated  in  the  Data 
Reduction  and  Analysis  Method  section  above. 

4. 4. 1.9. 3. 2  Significant  Problems. 

None . 

4. 4. 1.9. 3. 3  PTRs  Generated. 

None . 

4.4.1.10  Test  AL-05. 

The  objective  of  this  test  was  to  ensure  that  the  geographical 
screening  by  ADAS  did  not  eliminate  a  lightning  strike  that  was 
within  30  nmi  of  an  AWOS/ASOS,  even  though  the  strike  fell 
outside  of  the  ARTCC  geographical  screening  area. 

Further  objectives  of  this  test  were  to  verify  particular  ALDARS 
NAS-SS-1000  requirements  (see  appendix  A). 
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In  order  to  meet  these  objectives,  this  test  verified  that: 

a.  ADAS  properly  determined  the  proximity  of  lightning 
strikes  and  generated  a  message  for  each  AWOS/ASOS  when  the 
lightning  strikes  were  within  the  defined  geographical  areas 
surrounding  the  AWOS/ASOS. 

4.4.1.10.1  Description . 

This  scenario  involved  one  simulated  AWOS .  The  AWOS  was 
configured  using  the  ADAS  Specialist  Console  with  the  east  half 
of  its  30  nmi  area  of  coverage  located  outside  the  ARTCC 
geographical  screening  area.  (Note:  During  OT&E  #1,  ADAS  did  not 
support  the  capability  to  use  the  ADAS  Specialist  Console  to 
configure  the  AWOS  as  described.  Therefore,  it  was  configured  as 
described  in  the  configuration  file.  PTR  OTE-007  was  written 
during  the  conduct  of  test  AL-09  to  document  this  problem.)  The 
IPS  was  scripted  to  send  5  minutes  of  flash  records  that  fell  in 
that  part  of  the  AWOS's  30  nmi  area  of  coverage  that  was  within 
the  ARTCC  geographical  screening  area.  The  IPS  was  scripted, 
then,  to  send  5  minutes  of  flash  records  that  fell  in  that  part 
of  the  AWOS's  30  nmi  area  of  coverage  that  was  outside  the  ARTCC 
geographical  screening  area.  The  IPS  was  scripted  using  the 
Standard  and  Specified  Flash  message. 

4.4.1.10.2  Data  Reduction  and  Analysis  Method. 

NOTE:  Actual  analysis  may  find  that  some  messages  do  not  occur 

at  the  minutes  indicated  below.  This  is  the  result  of  the  delay 
of  the  IPS  sending  out  LDD  messages  as  the  script  progresses 
through  its  life  cycle.  The  following  is  a  description  as  to  why 
this  occurs. 

At  the  beginning  of  the  script,  the  LDD  flash  messages  are  sent 
to  ADAS  at  the  beginning  of  the  minute  or  mission  cycle.  As  the 
script  progresses,  the  LDD  flash  messages  experience  a  delay  in 
being  sent  to  ADAS  and,  therefore,  are  sent  to  ADAS  later  and 
later  into  the  minute/mission  cycle.  As  a  result,  when  the 
script  first  starts,  the  LDD  messages  sent  at  the  top  of  the 
minutes  get  processed  by  ADAS  during  that  minute's  mission  cycle. 
But  at  some  point  during  the  life  of  the  script,  the  LDD  message 
will  be  sent  to  ADAS  too  late  into  the  mission  cycle  and  as  a 
result  will  not  get  processed  during  that  minute's  mission  cycle. 
When  this  occurs  the  LDD  message  will  not  get  processed  until  the 
next  minute's  mission  cycle  and,  therefore,  it  appears  as  if  ADAS 
"skipped"  processing  LDD  messages  for  1  minute. 

The  LAD  messages  were  logged  on  the  IPS  as  part  of  the  AWOS 
incoming  message  log.  Analysis  of  the  LAD  messages  from  minute  2 
through  6  indicated  that  a  flash  occurred  in  zones  1  and  2  and  in 
the  zone  3  west  sector.  Analysis  of  the  LAD  from  minute  7 
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through  11,  indicated  a  flash  occurred  in  zones  1  and  2  and  in 
the  zone  3  east  and  west  sector. 

The  ITWS  messages  were  logged  on  the  IPS  as  part  of  the  ITWS 
incoming  message  log.  Analysis  of  the  ITWS1  LDD  message  from 
minute  1  through  5  indicated  that  three  flash  records  were  sent 
to  the  ITWS.  Analysis  of  the  ITWS1  LDD  for  minutes  6  through  11 
indicated  that  no  flash  records  were  sent  to  the  ITWS  (i.e.,  only 
date/time  stamps  were  present) . 

For  this  test,  two  out  of  four  Evaluation  Criteria  passed  and  two 
out  of  four  Evaluation  Criteria  failed.  The  Evaluation  Criteria 
used  to  determine  that  this  test's  requirements  were  verified  are 
contained  in  appendix  C. 

4.4.1.10.3  Results  and  Discussion. 

4.4.1.10.3.1  Data. 

See  appendix  C  for  a  list  of  the  files  that  contain  the  test  data 
results  and  evaluation  criteria  CR  numbers  indicated  in  the  Data 
Reduction  and  Analysis  Method  section  above. 

4.4.1.10.3.2  Significant  Problems.  • 

ADAS  did  not  report  lightning  strikes  to  an  AWOS  when  the _ 
lightning  strikes  fell  in  a  part  of  an  AWOS  that  was  outside  o 
an  ARTCC  boundary.  This  problem  could  easily  occur  in  the  field 
as  a  result  of  an  erroneous  entry  at  the  ADAS  Specialist  Console. 
Further,  this  would  result  in  lightning  strikes  not  being 
reported  to  an  AWOS.  Therefore,  this  problem  was . classified  as 
Major.  The  contractor,  DME  Inc.,  is  still  determining  how  to 
resolve  this  problem.  The  resolution  to  this  problem  is  to  be 
implemented  in  the  Y2K  software  build.  (Refer  to  PTR  OTE  038) . 

4.4.1.10.3.3  PTRs  Generated . 

See  appendix  B  for  the  complete  PTR  details.  The  PTR  generated 
with  respect  to  this  test  was: 

Major:  OTE-038  -  Open 


4.4.1.11  Test  AL-06 . 

The  objective  of  this  test  was  to  verify  particular  ALDARS  NAS- 
SS-1000  requirements  (see  appendix  A) . 

In  order  to  meet  these  objective,  this  test  verified  that  ALDARS 
could: 

a.  Properly  accept  and  interpret  data  from  the  NLDN  data 
source  at  the  specified  data  rate  of  1200  baud,  while  this  data 
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was  continuously  arriving  at  the  maximum  input  rate  of  1100 
lightning  strikes  per  minute. 

b.  At  the  maximum  input  rate  specified  in  (a),  detect  all 
error  conditions  in  the  LDD  input  stream:  TYPE_INVALID  (packet  is 
a  non-LDD  message) ,  DLE_INVALID  (DLE  packet  rule  violation) , 
SOP_INVALID  (SOP  detection  prior  to  EOP  violation) , 
EOP_SOP_INVALID  (start  of  packet  violation),  LENGTH_INVALID 
(exceeded  packet  size),  CHECKSUM_INVALID  (packet  checksum 
violation) . 

c.  At  the  maximum  input  rate  specified  in  (a),  properly 
maintain  performance  data  points  reflecting  the  status/condition 
of  the  NLDN  interface.  These  values  are:  LU  2D  (DP  1,  value  00) 
indicating  the  NLDN  Interface  connection  status  is  not 
configured,  LU  2D  (DP  1,  value  01)  indicating  the  NLDN  Interface 
connection  status  is  configured  but  failed,  and  LU  2D  (DP  1, 
value  02)  indicating  the  NLDN  Interface  connection  status  is 
configured  and  active. 

d.  At  the  maximum  input  rate  specified  in  (a),  capture  and 
form  all  valid  LDD  input  messages. 

e.  Properly  generate  LAD  messages  for  AWOS . 

f.  Disseminate  the  LAD  message  to  the  correct  AWOS  within  1 
minute. 

(NOTE:  The  following  was  combined  from  Test  AL-07) 

g.  Correctly  disseminate  LDD  messages  to  each  ITWS 
configured. 

1 .  Transmit  the  LDD  ADU  containing  flash  messages  to 
the  ITWS  every  5-seconds. 

2.  Not  include  in  the  ADU,  and  thus  do  not  transmit  to 
ITWS,  any  indication  of  any  Flash  Message (s)  which  are  missing 
during  a  given  second(s)  of  the  5-second  interval. 

h.  Correctly  disseminate  LAD  messages  to  each  of  a  maximum 
of  50  ASOS  and  25  AWOS  stations  configured  for  the  ADAS. 

1.  For  a  maximum  of  50  ASOS  and  25  AWOS  stations, 
transmit  to  each  station  for  which  lightning  activity  has  existed 
during  the  past  15  minutes,  a  LAD  message  every  1  minute. 

2.  Transmit  LAD  messages  to  AWOS  at  a  rate  of  152  bits 
per  minute  while  using  existing  communication  lines. 

i.  Disseminate  lightning  data  to  WMSCR  via  METAR  messages. 
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4.4.1.11.1  Description . 

The  IPS  was  scripted  using  the  Specified  Flash  Message  (SFM) . 

The  IPS  generated  1100  flashes  per  minute  with  one  flash  falling 
in  each  of  the  10  zones/sectors  for  50  ASOSs  and  25  AWOSs  (1  AWOS 
must  be  live) .  (NOTE:  Although  the  IPS  was  sending  1100  flashes 
and  the  ADAS  was  processing  these  1100,  only  750  of  these  flashes 
were  associated  with  a  LAD  enabled  AWOS/ASOS) .  The  flash 
locations  in  each  zone/sector  were  identical  for  each  AWOS. 

(NOTE:  Since  in  this  test  ADAS  needed  to  detect  the  NLDN 
communications  going  from  CFG  ACTIVE  to  CFG  NOT  and  vice  versa, 
there  needed  to  be  a  1-second  pause  in  the  NLDN  data  every  minute 
to  minute  and  a  half.  This  allowed  the  ADAS  to  detect  the  state 
change  in  the  NLDN  communications.  Although  this  reduced 
slightly  the  1100  strikes  per  minute  maximum,  this  more  than 
satisfied  the  stress  conditions  of  the  live  operational  mode.) 

4.4.1.11.2  Data  Reduction  and  Analysis  Method. 

The  following  was  the  expected  output  for  Minutes  1  -  198. 

Minute  1-37:  For  any  METAR  or  SPECI,  the  live  AWOS 

indicated  lightning  occurring  at  the  airport 
in  the  present  weather  message  and  lightning 
occurred  in  the  distance  for  all  quadrants  in 
the  remarks  section  of  the  weather  message. 
Also,  in  the  remarks  section  there  was  an 
indication  that  the  thunderstorm  began. 

Each  LAD  message  indicated  10  flashes  per 
AWOS  per  minute.  The  logged  LADs  revealed  a 
total  of  750  flashes  per  minute  (Note  1 : 
although  we  were  receiving  1100  strikes, 
since  we  only  enabled  75  AWOS/ASOS  we  only 
had  750  strikes  in  the  LAD  file.  Note  2: 

Some  of  the  stations  were  set  up  right  along 
the  ARTCC  boundaries.  As  a  result,,  some  of 
their  sectors  were  outside  the  ARTCC 
boundaries  and,  therefore,  these  sectors  did 
not  indicate  lightning  in  the  LADs.  This 
problem  was  documented  in  test  AL-05  in  PTR 
OTE-038.)  Each  AWOS  incoming  message  log  had 
the  following  flash  message  structure  per 
minute: 

Zone  Sector  Comments 


Flash  occurred  in. center 
of  zone  at  the  ARP. 

Flash  occurred  7  nmi  out 
from  ARP  at  180°. 

Flash  occurred  20  nmi  out 
from  ARP  at  0” . 


1  N/A 

2  N/A 

3  1 
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2  Flash  occurred  20  nmi  out 
from  ARP  at  45’. 

3  Flash  occurred  20  nmi  out 
from  ARP  at  90". 

4  Flash  occurred  20  nmi  out 
from  ARP  at  135". 

5  Flash  occurred  20  nmi  out 
from  ARP  at  18  0'  . 

6  Flash  occurred  20  nmi  out 
from  ARP  at  225". 

7.  Flash  occurred  20  nmi  out 

from  ARP  at  270°. 

8  Flash  occurred  20  nmi  out 

from  ARP  at  315°. 

Minute  39-55:  Analysis  of  the  ASC  screen  NLDN 

Datapoints  indicated  that  the  NLDN  interface 
connection  status  was  CFG  NOT.  The  NLDN 
communications  LU,  0x2d,  Data  point  printout 
also  indicated  that  the  NLDN  was  not 
configured  (Note:  This  failed.  See  PTR  OTE- 
042  and  OTE-043 . ) 

Minute  57:  Analysis  of  the  ASC  screen  NLDN 

Datapoints  indicated  that  the  NLDN  interface 
connection  status  was  CFG  ACTIVE. 

Minute  60  -  73:  Analysis  of  the  ASC  screen  NLDN 

Datapoints  indicated  that  the  NLDN  interface 
connection  status  was  CFG  FAILED.  The  NLDN 
communications  LU,  0x2d,  Data  point  printout 
indicated  that  the  NLDN  communications  had 
failed.  (Note:  This  failed.  See  PTR  OTE-042 
and  OTE-043 . ) 

The  ITWS  incoming  message  log  indicated  that' 
no  LDD  has  been  transferred.  No  data  were 
included  in  the  ITWS  file. 

Minute  75  -  90:  Analysis  of  the  ASC  screen  NLDN 

Datapoints  indicated  that  the  NLDN  interface 
connection  status  was  CFG  ACTIVE.  At  Minute 
80,  the  NLDN  communications  LU,  0x2d,  Data 
point  printout  indicated  that  the  NLDN 
communications  was  active.  (Note:  This 
failed.  See  PTR  OTE-042  and  OTE-043.) 

For  every  METAR  or  SPECI,  the  live  AWOS 
indicated  lightning  occurring  at  the  airport 
in  the  present  weather  message  and  lightning 
occurring  in  the  distance  for  all  quadrants 
in  the  remarks  section  of  the  weather 
message.  Also,  in  the  remarks  section,  there 
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was  an  indication  that  the  thunderstorm 
began. 

Each  LAD  message  indicated  10  flashes  per 
AWOS  per  minute.  The  logged  LADs  revealed  a 
total  of  750  flashes  per  minute.  (Note  1: 
although  we  were  receiving  1100  strikes, 
since  we  only  enabled  75  AWOS/ASOS,  we  only 
had  750  strikes  in  the  LAD  file.  Note  2: 

Some  of  the  stations  were  set  up  right  along 
the  ARTCC  boundaries.  As  a  result,  some  of 
their  sectors  were  outside  the  ARTCC 
boundaries  and,  therefore,  these  sectors  did 
not  indicate  lightning  in  the  LADs.  This 
problem  was  documented  in  test  AL-05  in  PTR 
OTE-038 . ) 

Each  AWOS  incoming  message  log  had  the 
following  flash  message  structure  per  minute: 

Zone  Sector  Comments 

1  N/A  Flash  occurred  in  center 

of  zone  at  the  ARP. 

2  N/A  Flash  occurred  7  nmi  out 

from  ARP  at  180' . 

3  1  Flash  occurred  20  nmi  out 

from  ARP  at  0'  . 

2  Flash  occurred  2  0  nmi  out. 
from  ARP  at  45' . 

3  Flash  occurred  20  nmi  out 
from  ARP  at  90  . 

4  Flash  occurred  20  nmi  out 
from  ARP  at  135'. 

5  Flash  occurred  20  nmi  out 
from  ARP  at  180'. 

6  Flash  occurred  20  nmi  out 
from  ARP  at  225  . 

7  Flash  occurred  20  nmi  out 
from  ARP  at  27  0'. 

8  Flash  occurred  20  nmi  out 
from  ARP  at  315'. 


Minute  91  -  198:  For  every  METAR  or  SPECI,  the  live  AWOS 

indicated  lightning  occurring  at  the  airport 
in  the  present  weather  message  and  lightning 
occurring  in  the  distance  for  all  quadrants 
in  the  remarks  section  of  the  weather 
message.  Also,  in  the  remarks  section,  there 
was  an  indication  that  the  thunderstorm 
began. 
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Each  LAD  message  indicated  10  flashes  per 
AWOS  per  minute.  The  logged  LADs  revealed  a 
total  of  750  flashes  per  minute.  (Note  1: 
although  we  were  receiving  1100  strikes, 
since  we  only  enabled  75  AWOS/ASOS,  we  only 
had  750  strikes  in  the  LAD  file.  Note  2: 

Some  of  the  stations  were  set  up  right  along 
the  ARTCC  boundaries.  As  a  result,  some  of 
their  sectors  were  outside  the  ARTCC 
boundaries  and,  therefore,  these  sectors  did 
not  indicate  lightning  in  the  LADs.  This 
problem  was  documented  in  test  AL-05  in  PTR 
OTE-038.)  Each  AWOS  incoming  message  log  had 
the  following  flash  message  structure  per 


minute: 

Zone 

Sector 

Comments 

1 

N/A  .  - 

Flash  occurred  in  center 
of  zone  at  the  ARP. 

2 

N/A 

Flash  occurred  7  nmi  out 
from  ARP  at  180'. 

3 

1 

Flash  occurred  20 
from  ARP  at  0' . 

nmi  out 

2 

Flash  occurred  20 
from  ARP  at  45' . 

nmi  out 

3 

Flash  occurred  20 
from  ARP  at  90' . 

nmi  out 

4 

Flash  occurred  20 
from  ARP  at  135' . 

nmi  out 

5 

Flash  occurred  20 
from  ARP  at  180' . 

nmi  out 

6 

Flash  occurred  20 
from  ARP  at  225'. 

nmi  out 

7 

Flash  occurred  20 
from  ARP  at  270'/. 

nmi  out 

8 

Flash  occurred  20 
from  ARP  at  315' . 

nmi  out 

Additionally,  during  minutes  91  - 

198,  the  following 

LDD 

stream  errors  were  recorded  in  the  ADAS  event  error  log: 

Minutes  91-108:  Event  21,  TYPE_INVALID  (packet  is  a 

non-LDD  message) . 

Minutes  109-126:  Event  21,  DLE_ INVALID  (DLE  packet  rule 
violation) . 

Minutes  127-144:  Event  21,  SOP_INVALID  (SOP  detection  prior 
to  EOP  violation) . 

Minutes  145-162:  Event  21,  CHECKSUM_INVALID  (packet 
checksum  violation):. 
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Minutes  163-180:  Event  21,  LENGTH_INVALID  (exceeded  packet 
size)  . 

Minutes  181-198:  Event  21,  EOP_SOP_INVALID  (start  of  packet 
violation) . 


The  ITWS  Input  Message  Logs  indicated  approximately  1100  flash 
records  were  reported  per  minute  for  a  total  of  187,000  messages 
received  from  ADAS  (1100  messages  per  minute  for  198  minutes, 
excluding  minutes  1-6,  38-48,  and  49-59) . 


The  WMSCR  Input  Message  Log  should  indicate  that  hourly  METARs 
were  recorded  for  each  simulated  and  live  AWOS/ASOS.  (NOTE. 

Since  one  of  the  IPS  channels  was  out,  six  of  the  simulated  AWOSs 
did  not  report  a  METAR) . 


For  this  test,  11  out  of  13  Evaluation  Criteria  fully  passed,  1 
out  of  13  Evaluation  Criteria  partially  passed,  and  1  out  of  13 
Evaluation  Criteria  were  verified  in  the  AL-01  tests.  The 
Evaluation  Criteria  used  to  determine  that  this  test's 
reguirements  were  verified  are  contained  in  appendix  C.. 

4.4.1.11.3  Results  and  Discussion. 


4.4.1.11.3.1  Data. 

See  appendix  C  for  a  list  of  the  files  that  contain  the  test  data 
results  and  evaluation  criteria  CR  numbers  indicated  m  the  Data 
Reduction  and  Analysis  Method  section  above. 

4.4.1.11.3.2  Significant  Problems. 

a.  Analysis  of  data  for  OT&E  #1,  AL-06  test  revealed  that 
the  NLDN  Communications  DP  printout  indicated  the  NLDN 
Availability  Status  as  "online-normal"  and  the  Value  as  config 
active"  for  the  conditions  when  the  NLDN  was  set  to  "out  of 
service"  and  when  the  NLDN  to  ADAS  was  disconnected.  Further 
testing  during  DT&E  #2  and  OT&E  #2  seemed  to  indicate  that  the 
NLDN  Communications  and  ITWS  Communications  LU/DP  printouts  were 
not  coded  correctly.  Therefore,  this  PTR  remains  open,  but  has 
been  downgraded  to  a  Moderate  classification.  (Refer  to  PTR  OTE 
042.) 

b.  Analysis  of  the  IPS  MPS  file  for  OT&E  #1,  test  AL-06 
revealed  that  the  NLDN  Interface  Connection  Status  DP  did  not 
reflect  the  current  condition  of  the  NLDN  Interface.  At  10:59  of 
this  test,  the  NLDN  was  placed  in  an  "out  of  service  condition. 
At  11:01,  the  NLDN  Interface  Connection  Status  DP  indicated  a 
Condition  Status  of  "configured  active".  Then  at  11:18,  the 
cable  from  the  NLDN  to  ADAS  was  disconnected.  It  was  not  until 
11:31  that  the  NLDN  Interface  Connection  Status  DP  indicated  a 
Condition  Status  of  "configured  failed".  At  11:35,  the  NLDN 
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cable  was  reconnected  to  ADAS;  however,  it  was  not  until  12:16 
that  the  NLDN  Interface  Connection  Status  DP  indicated  a 
Condition  Status  of  "configured  active". 

Further  testing  indicated  that  ADAS  fails  to  set  the  DP  correctly 
when  ADAS  is  under  the  maximum  load  conditions.  Since  ADAS  was 
using  up  the  whole  mission  cycle  to  process  lightning  strikes,  it 
did  not  always  properly  set  the  DP  indicating  NLDN  was  down.  DME 
implemented  a  fix  for  this  problem  in  build  4.19.  The  problem 
was  retested  during  DT&E  #2  and  OT&E  #2  and  was  verified  as 
corrected.  Therefore,  this  PTR  has  been  closed.  (Refer  to  PTR 
OTE-043 . ) 

4.4.1.11.3.3  PTRs  Generated. 

See  appendix  B  for  the  complete  PTR  details.  The  PTRs  generated 
with  respect  to  this  test  are: 

Critical:  OTE-041  -  Closed 

Major:  .  OTE-043  -  Closed 

Moderate:  OTE-042  -  Open 

4.4.1.12  Test  AL-07. 

This  test  was  combined  with  Test  AL-06. 

4.4.1.13  Test  AL-08. 

The  objective  of  this  test  was  to  verify  particular  ALDARS  NAS- 
SS-1000  requirements  (see  appendix  A) . 

To  meet  these  objectives  this  test  performed  the  following: 

a.  verified  that  ADAS  detected  a  physical  interrupt  or 
disconnect  condition  of  the  NLDN  link, 

b.  verified  that  ADAS,  in  an  operational  environment, 
detected  satellite  disconnects  from  the  NLDN, 

c.  verified  that  ADAS,  in  an  operational  environment, 
detected  errors  in  the  LDD  message  from  the  NLDN, 

d.  verified  that  AWOS/ASOS  reported  correctly  when  ADAS 
data  was  unavailable. 

4.4.1.13,1  Description. 

This  test  evaluated  the  handling  of  the  physical  NLDN  link 
disconnection  by  ADAS.  It  also  evaluated  the  handling  of  a 
satellite  interrupt  in  the  operational  NLDN  satellite  link  by 
ADAS.  Additionally,  this  test  evaluated  the  ability  of  ADAS  to 
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detect  errors  in  operational  LDD  messages  from  the  NLDN.  Also, 
since  live  NLDN  data  was  used,  the  latitude  and  longitude  data 
(in  the  configuration  files)  for  live  AWOSs  and  ASOSs  was  moved 
to  where  the  lightning  was  occurring. 

4.4.1.13.2  Data  Reduction  and  Analysis  Method. 

The  following  analysis  method  was  utilized  on  the  output  data  for 
this  test. 

a.  Upon  disconnection  of  the  NLDN  cable  to  the  ADAS,  the 

ITWS  file  contained  no  LDD  Flash  Record  data  for  the  time  ^  ■ 

associated  with  the  disconnect.  During  this  same  time  Period, 
the  DLP  file  indicated  that  the  live  AWOS  began  to  report  L 
DATA  MISG  15  minutes  after  the  disconnect.  Also,  the  ME TAR/ SPEC 
reports  contained  an  LTG  DATA  MISG  in  the  remarks  field. 

Finally,  the  ADAS  event  log  indicated  that  Event  62  (comm  status, 
enabled- failed)  had  occurred. 

b.  Upon  reconnection  of  the  NLDN  cable  to  the  ADAS,  the 
ITWS  file  contained  LDD  Flash  Record  data  for  the  time  associated 
with  the  reconnect.  During  this  same  time  period,  the  DLP  file 
indicated  that  the  live  AWOS  stopped  reporting  LTG  AATA  MISG 
Also,  the  METAR/SPECI  reports  did  not  contain  an  LTG  DATA  MISG 
the  remarks  field.  Finally,  the  ADAS  event  log  indicated  that 
Event  62  (comm  status:  enabled-active)  had  occurred. 

c.  Upon  repositioning  of  the  NLDN  satellite  dish  (in  order 

to  generate  LDD  message  errors),  ADAS  identified  the  ADD  message 
errors.  The  ADAS  event  log  indicated  that  numerous  Event  21  type 
messages  occurred  during  the  time  associated  with  the 
repositioning  of  the  satellite  dish.  The  error  type  was  NLDN 
error  message"  and  the  error  code  was  always  one  of  the  .  , 

following:  "Invalid  message  type",  "Invalid  checksum  ,  Invalid 
SOP-EOP  sequence",  or  "Invalid  SOP  sequence".  An  exact  . 

correlation  could  not  be  made  between  the  errors  recorded  on  the 
NLDN  Thunder  Box  Satellite  Diagnostics  display  (see  the  test 
procedure  steps) ;  however,  a  qualitative  assessment  could  be  made 
to  determine  if  the  ADAS  event  log  reflected  the  errors  reported 
on  the  Thunder  Box  display. 

d.  Upon  disconnecting  ADAS  from  the  AWOS,  the  AWOS  reported 
that  ADAS  data  was  unavailable.  This  was  verified  by  the  DLP 
file  where  there  were  no  reports  from  the  AWOS  during  the  time  of 

disconnect . 

e.  Upon  reconnecting  ADAS  to  the  AWOS,  the  AWOS  reported 
that  ADAS  data  was  available.  This  was  verified  by  the  DLP  file 
where  there  were  reports  from  the  AWOS  after  the  time  of 
disconnect. 
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For  this  test,  six  out  of  six  Evaluation  Criteria  passed.  The 
Evaluation  Criteria  used  to  determine  that  this  test's 
requirements  were  verified  are  contained  in  appendix  C.  ■ 

4.4.1.13.3  Results  and  Discussion, 

4.4.1.13.3.1  Data . 

See  appendix  C  for  a  list  of  the  files  that  contain  the  test  data 
results  and  evaluation  criteria  CR  numbers  indicated  in  the  Data 
Reduction  and  Analysis  Method  section  above. 

4.4.1.13.3.2  Significant  Problems. 

a.  Analysis  of  data  for  test  AL-08  (OT&E  #1  file  al-08- 
1 • cap)  revealed  that  the  LTG  DATA  MISG  remark  was  not 
incorporated  into  the  ME TAR  message.  At  13:31,  the  cable  to  the 
NLDN  controller  was  disconnected.  At  13:44,  the  AWOS  (OTIS)  OMO 
included  a  LTG  DATA  MISG  remark  in  Field  22  and  Field  21  (Octet 
68),  bit  3  was  also  set.  OTIS  continued  to  send  this  remark  in 
each  OMO  up  to  and  including  the  14:04  OMO.  However,  the  METAR 
at  14:00  did  not  include  the  LTG  DATA  MISG  remark. 

The  problem  was  that  a  space  had  been  added  to  the  OTIS  OMO 
automated  lightning  remarks.  Therefore,  when  the  ADAS  code 
checked  octet  69  and . found  the  blank  space,  it  assumed  no  auto 
remarks.  To  fix  this  problem,  the  ADAS  software  was  modified  to 
search  beyond  the  blank  space  for  any  remarks. 

This  problem  was  verified  as  corrected  during  DT&E  #2  and  OT&E 
#2.  Data  from  OTE  #2  al-06-l.cap  verified  that  the  OTIS  OMO  LTG 
DATA  MISG  automated  remarks  were  in  the  METARs,  therefore,  this 
PTR  was  closed.  (Refer  to  PTR  OTE-031.) 

b.  At  13:31  during  test  AL-08  the  cable  to  the  NLDN 
controller  was  disconnected.  It  was  not  until  13:44  that  the 
OTIS  OMO  indicated  that  lightning  was  unavailable.  This  was  a 
result  of  ADAS  not  setting  the  LAD  availability  bit  (i.e.,  NLDN 
is  not  available)  until  15-minutes  after  the  NLDN  was 
disconnected.  This' is  in  violation  of  the  ICD  par  30.3.2.2  which 
states  that  the  availability  bit  "shall  indicate  the  current 
availability  of  lightning  information  to  AWOS".  DME  interpreted 
"current  availability"  as  including  the  15-minute  persistence  of 
lightning  strikes.  However,  at  the  Program  Management  Review  in 
November  1997,  AUA-430  determined  that  whenever  the  ADAS  stops 
receiving  lightning  data  from  the  NLDN,  the  LAD  availability  bit 
should  be  set  to  indicate  that  lightning  is  unavailable. 

Therefore,  if  a  lightning  remark  or  TSB  is  still  within  a 
15-minute  persistence  window  and  the  ADAS  stops  receiving 
lightning  for  2  consecutive  minutes,  then  the  LAD  availability 
bit  should  be  set  to  1,  Thunderstorm  No. (TSNO)  should  be  issued 
and  all  lightning  remarks  and  TSBs  should  be  removed.  It  was 
decided  that  AUA  would  clarify  the  resolution  to  this  problem  and 
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provide  DME  with  direction  on  how  to  resolve  for  the  Y2K  build. 
Even  though  this  is  a  Major  PTR,  it  was  deferred  until  the  Y2K 
build.  (Refer  to  PTR  OTE-033 . 

c.  PTR  OTE-034  was  also  discovered  during  this  test.  At 
the  time,  it  was  thought  to  be  a  separate  problem  from  PTR 
OTE-033 .  However,  it  has  been  determined  that  both  PTRs  are _ 
related  and  require  the  same  solution.  This  PTR  was  classified 
as  Major  and  remains  open.  (Refer  to  PTR  OTE-034.) 

d.  Analysis  of  the  test  AL-08  event  log  revealed  that 
during  times,  when  no  communications  problems  existed  for  the 
ADAS/NLDN  interface,  an  EVENT  21  was  generated.  These  EVENT  21 
messages  were  always  generated  around  :45  seconds  past  the 
minute.  The  following  is  an  example  of  this. 

EVENT  PRIORITY:  non-critical  DATE/TIME  STAMP:  09-12-97 
13*26:45 

EVENT VSEQ.  NUMBER:  289  EVENT  TYPE:  21  CSC  ID:  11.02 

An  erroneous  message  has  been  triggered  by  System  Logging. 

message  type:  ADAS  received  error  message 

error  type:  NLDN  error  message  error  code:  Invalid  message 

type 

original  esc  id:  22.01  error  number:  12 
error  offset:  353 

At  the  Program  Management  Review  in  November  1997,  DME  explained 
that  EVENT  21  messages  are  generated  every  minute  because  every 
minute  the  NLDN  system  sends  a  messages  that  is  erroneous  (based 
on  the  ADAS  Spec  requirements) .  As  a  result,  ADAS  generates  this 
message'.  It  was  determined  at  the  PMR  that  DME  would  generate  a 
Program  Change  Report  about  this  problem  and  AUA-430  would  direct 
them  to  fix  it  by  removing  EVENT  21  messages  corresponding  to 
these  NLDN  messages  that  are  sent  every  minute.  DME  would 
incorporate  the  necessary  changes  for  the  Y2K  build.  This  PTR 
was  classified  as  Moderate  and  remains  open.  (Refer  to  PTR  OTE- 
044. ) 

4,4.1.13.3.3  PTRs  Generated. 

See  appendix  B  for  the  complete  PTR  details.  The  PTRs  generated 
with  respect  to  this  test  are: 

Major:  OTE-031  -  Closed 

OTE-033  -  Open 

OTE-034  -  Open 

Moderate:  OTE-044  -  Open 
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4.4.1.14  Test  AL-09. 

The  objective  of  this  test  was  to  verify  particular  ALDARS  NAS- 
SS-1000  requirements  (see  appendix  A) . 

In  order  to  meet, this  objective,  this  test  determined  that: 

a.  ADAS  could  process,  store,  and  maintain  a  database  to 
keep  track  of  AWOSs,  ASOSs,  and  ITWSs  that  were  enabled  to 
receive  NLDN  lightning  data. 

b.  ADAS  could  properly  determine  the  proximity  of  lightning 
strikes  and  generate  a  message  for  each  AWOS/ASOS  when  the 
lightning  strikes  were  within  the  defined  geographical  areas 
surrounding  the  AWOS/ASOS. 

c.  ADAS  maintained  the  status  of  lightning  activity 
•movement  and  identified  the  cessation  of  lightning  activity  for 
each  AWOS/ASOS. 

d.  ADAS  maintained  a  count  of  lightning  strikes  for  the 
last  15  minutes  for  each  of  the  10  zones/sectors  about  the 
AWOS/ASOS  ARP.  [NOTE:  ADAS  maintained  these  counts  internally 
and,  therefore,  it  could  only  be  determined  through  code 
inspections.  Code  inspections  were  performed  at  DT&E  and  were 
not  performed  during  OT&E.  However,  ADAS  LAD  messages  do 
maintain  a  15-minute  persistence  for  lightning  activity  for  each 
zone/sector.  This  capability  was  verified  during  OT&E.] 

e.  ADAS  used  the  existing  communications  lines  to  transport 
the  LAD  messages  to  the  AWOSs/ASOSs. 

f.  AWOS/ASOS  received  the  once  per  minute  LAD  data  sent  by 
ADAS  and  identified  thunderstorms  in  the  surface  observations  by 
reporting  it  when  the  lightning  was  presently  active. 

4.4.1.14.1  Description. 

This  scenario  involved  the  live  NLDN  interface  and  a  minimum  of 
one  live  AWOS,  or  one  live  ASOS,  and  one  simulated  AWOS/ASOS  that 
replicated  the  live  station.  (Note:  the  ADAS  does  not  allow  the 
simulated  and  live  sites  to  be  exactly  the  same  location, 
therefore,  the  latitudes  were  set  apart  by  .05  minutes.)  This 
test  was  run  at  more  than  once  for  the  AWOS  and  the  ASOS.  The 
simulated  station  replicated  whichever  type  station  was  live. 

The  key  to  this  test  was  to  track  a  current  thunderstorm  using 
the  NLDN  display  in  the  ADAS  PSF  and  then  to  "trick"  the  ADAS 
into  processing  the  lightning  detection  data  as  if  the  AWOS  or 
ASOS  were  located  in  the  area  where  the  thunderstorm  was 
occurring. 
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This  test  required  some  quick  work  on  the  ASC  to  "move"  the  AWOS- 
or  ASOS  to  the  location  where  the  thunderstorm (s)  were  occurring. 
This  required  the  use  of  the  NLDN  display  system  in  order  to 
anticipate  and  predict  where  thunderstorm  activity  would  provide 
sufficient  lightning  activity  sufficient  to  verify  the  ALDARS 
requirements.  By  analyzing  the  NLDN  display  (and  other 
meteorological  resources  available  at  the  FAA  Technical  Center), 
a  particular  location (s)  was  identified  to  have  a  high 
probability  for  occurrence  of  heavy  lightning  activity.  The  test 
operator  used  the  ASC  to  "move"  the  ADAS  in  order  that  the . 
boundaries  of  the  ARTCC  (ADAS)  included  this  lightning  activity 
area  (LAA) .  The  latitude  and  longitude  of  the  ARTCC  boundaries 
were  set  up  in  order  that  the  ASOS  or  AWOS  could  be  placed  50  nmi 
from  the  boundaries  of  the  ADAS  and  the  station  was  still  in  the 
path"  of  the  LAA.  To  allow  for  the  30  nmi  area  of  the  ASOS  or 
AWOS  plus  20  nmi,  50  nmi  was  necessary.  The  test  operator  also 
used  the  ASC  to  "move"  the  AWOS  or  ASOS  to  a  latitude  and 
longitude  within  the  ARTCC  (ADAS)  boundaries  and  "in  the  path"  of 
the  LAA. 

Once  the  lightning  strikes  moved  to  within  10  nmi  of  the  ARTCC 
(ADAS)  boundaries,  the  logging  of  LAD  and  LDD  messages  commenced 
by  beginning  test  AL-09  on  the  IPS. 

The  scenario  continued  until  the  thunderstorm  "moved  away  from 
the  AWOS  or  ASOS.  It  was  determined  that  the  lightning  had  moved 
more  than  30  nmi  from  the  AWOS/ASOS  by  using  the  "range-circles' 
capability  of  the  NLDN  system. 

On  the  NLDN  system,  the  lightning  strike  buffer  was  saved  to  disk 
for  comparison,  during  data  analysis,  to  the  captured  LAD 
messages. 

The  IPS  DLP  AWOS  file  was  saved.  This  file  contained  the 
1-minute  AWOS  format  messages  sent  by  the  AWOS/ASOS.  These 
messages  were  inspected  to  determine  if  the  LAD  messages  were 
properly  received  and  incorporated  by  the  AWOS/ASOS. 

The  ADAS  processed  and  archived  the  ADAS  generated  (i.e.,  AWOS 
only)  METAR  and  SPECI  messages  and  the  IPS  logged  the  METAR  and 
SPECI  messages  generated  by  both  the  ADAS  and  ASOS.  These 
messages  were  in  the  IPS  WMSCR  METAR  file  and  used  during  DR&A  to 
determine  if  the  METAR/SPECI  messages  were  correct. 

The  IPS  LAD  message  file  contained  the  LAD  messages  generated  for 
the  simulated  AWOS/ASOS  that  replicated  the  live  site. 

4.4.1.14.2  Data  Reduction  and  Analysis  Method. 

DR&A  was  performed  by  comparing  archived  lightning  activity  from 
the  NLDN  system  to  the  LAD  messages  that  were  captured  on  the 
IPS.  The  archived  NLDN  data  was  recalled  by  selecting  the 
appropriate  file  from  those  files  stored  on  disk.  By  using  the 
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ANIMATION  screen  this  data  was  "stepped"  through  (minute  by- 
minute)  and  compared  to  the  LAD  messages  that  were  sent  to  the 
AWOS  or  ASOS.  For  the  AWOS/ASOS,  the  NLDN  data  and  LADs  were 
compared  to  the  captured  IPS  DLP  and  WMSCR  METAR  message  log. 

For  this  test,  22  out  of  23  Evaluation  Criteria  fully  passed  and 
1  out  of  23  Evaluation  Criteria  partially  passed.  The  Evaluation 
Criteria  used  to  determine  that  this  test' s  requirements  were 
verified  are  contained  in  appendix  C. 

4.4.1.14.3  Results  and  Discussion. 

4.4.1.14.3.1  Data. 

See  appendix  C  for  a  list  of  the  files  that  contain  the  test  data 
results  and  evaluation  criteria  CR  numbers  indicated  in  the  Data 
Reduction  and  Analysis  Method  section  above. 

4.4.1.14.3.2  Significant  Problems . 

a.  PTRs  OTE-007  and  OTE-030  were  generated  during  OT&E  #1. 
These  PTRs  were  written  because  the  ASC  screens  did  not  allow  for 
changing  the  AWOS  station  latitude  and  longitude  or  the  AWOS 
station  LAD  enable/disable  setting.  Both  of  these  PTRs  were 
verified  as  corrected  during  DT&E  #2  and  OT&E  #2.  During  OT&E 
#2,  these  PTRs  were  verified  as  corrected  by  the  performance  of 
the  AL-09  Test  Conduct  Form  (TCF) .  Both  PTRs  were  classified  as 
Critical  and  have  been  closed.  (Refer  to  PTRs  OTE-007  and 
OTE-030 . ) 

b.  During  test  AL-09  (OT&E  #1),  on  8/27/97  from  14:41,  the 
OTIS  AWOS  never  reported  any  Automated  Remarks  for  Lightning. 

OTIS  did  report  TSB44,  but  never  reported  any  lightning  for  any 
of  the  sectors,  vicinity,  or  at  airport.  Further  analysis 
determined  that  this  problem  (and  OTE-031)  were  the  result  of  a 
blank  space  in  the  AWOS  automated  lightning  remark.  As  a  result, 
DME  modified  the  software  to  look  at  the  whole  automated  remark 
field  for  lightning  remarks.  This  modification  was  tested  during 
DT&E  #2  and  OT&E  #2.  OT&E  #2  file  al-02c-l.cap  contains  the  data 
verifying  that  this  problem  was  corrected.  This  PTR  was 
classified  as  Major  and  has  been  closed.  (Refer  to  PTR  OTE-008.) 

c.  During  Test  AL-09-1  (OT&E  #1),  a  thunderstorm  began  and 
was  reported  as  TSB44  (i.e.,  1444);  however,  no  TE  was  ever 
generated  and  eventually  the  TSB44  was  dropped  out  of  the 
reports.  DME  implemented  a  fix  to  correct  this  problem  (PTR  OTE- 
010).  This  problem  was  verified  as  corrected  during  DT&E  #2  and 
OT&E  #2.  OT&E  #2  file  al-02c-l.cap  contains  the  data  verifying 
that  this  problem  was  corrected.  However,  as  a  result  of  the 
analysis  to  verify  that  this  problem  was  corrected,  another 
problem  was  found  and  documented  in  PTR  OTE-052.  PTR  OTE-010  was 
classified  as  Major  and  has  been  closed.  (Refer  to  PTR  OTE-010). 
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d.  During  Test  AL-09  (OT&E  #1),  it  was  noticed  that  the 
ADAS-generated  METAR/SPECI  messages  that  had  conflicting  time 
information  for  the  Thunderstorm  Begin/End  Automated  Remarks. 

The  time  stamp  placed  at  the  beginning  of  the  METAR/SPECI  was  2 
minutes  earlier  than  when  the  Automated  Remark  indicated  that  the 
Thunderstorm  Began  or  Ended.  Here  is  a  sample  of  what  was 
observed  and  recorded. 

SPECI  OTIS  281323Z - TSB25 

DME  implemented  a  fix  for  this  problem.  This  problem  was 
verified  as  corrected  during  DT&E  #2  and  OT&E  $2 .  OT&E  §2  file 
al-02c-l . cap  contains  the  data  verifying  that  this  problem  was 
corrected.  This  problem  was  classified  as  Critical  and  has  been 
closed.  (Refer  to  PTR  OTE-012). 

e.  Analysis  of  the  results  for  OT&E  #2  test  data  al-09- 
2. cap  indicated  that  when  the  AWOS  (OTIS)  station  was  LAD 
disabled  at  14:34  and  remained  disabled  until  14:56,  no  TSExx  was 
generated.  At  1433Z,  an  OTIS  SPECI  was  generated  indicating 
"LTG  DSNT  NE  AND  SE  TSB13" .  The  next  report  for  OTIS  was  the _ 
hourly  METAR  at  1500Z  which  contained  no  remarks  about  lightning. 
ACT-320  wrote  PTR  OTE-055  believing  that  there  should  have  been 
an  indication  in  the  METAR  that  the  lightning  had  ended. 

However,  since  the  LAD  disable  was  more  than  15  minutes,  ADAS 
handled  the  event  properly  and  cleared  the  TS  remarks.  ACT 
retested  on  April  8,  1998,  to  determine  what  would  occur  if  the 
LAD  was  disabled  for  less  than  10  minutes.  Based  on  the  AL-09 
test  on  April  8,  1998,  ADAS  cleared  the  event  even  though  it  was 
less  than  10  minutes.  This  is  consistent  with  the  SPEC  but 
inconsistent  with  the  ADAS/AWOS  ICD  paragraph  90.3.2.12.1.5.3. 
Therefore,  it  was  recommended  that  the  ICD  be  clarified  and 
updated  to  exclude  the  LAD  Disabled  LTG  DATA  MISG  condition  from 
the  continuation  criteria  when  less  than  15  minutes.  This  PTR 
has  been  classified  as  Moderate  and  remains  open;  (Refer  to  PTR 
OTE-055 . ) 

f .  During  OT&E  #2  Test  AL-09,  ACT-320  discovered  that  the 
NLDN  LDD  Quality  Factor  Bit  (QFB)  appeared  to  have  been 
flip-flopped  (i.e.,  good  flashes  had  a  QFB  set  to  bad  and  bad 
flashes  had  a  QFB  set  to  good) .  During  the  few  days  of  running 
this  live  test,  roughly,  95  percent  of  all  flashes  had  the  QFB 
set  as  bad.  ACT-320  reported  this  to  Global  Atmospherics,  Inc. 
(GAI) .  (The  providers  of  the  lightning  data  to  the  FAA) . 

GAI  researched  this  apparent  problem  and  discovered  that  the  QFB 
had  been  flip-flopped.  GAI  software  engineers  reported  that 
* somehow"  the  NLDN  software  had  been  modified  and  this  error  was 
incorporated.  The  GAI  spokesman,  William  Brooks,  did  not  have 
any  details  from  the  software  engineers  as  to  how  this  error 
occurred.  Mr.  Brooks  reported  that  GAI  had  corrected  the 
software  and  that  the  problem  was  resolved.  ACT-320  has 
requested  that  the  GAI  software  engineers  provide  a  full 
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explanation  as  to  how  this  problem  occurred  and  what  measures 
have  been  taken  to  ensure  that  it  does  not  occur  in  the  future. 
ACT-320  has  not  received  a  response  from  GAI  at  the  time  of  this 
report's  release.  Since  this  problem  is  Major,  ACT-320 
recommended  that  the  ADAS  software  be  modified  to  monitor  the  QFB 
to  ensure  that  this  error  is  detected  if  it  occurs  in  the  future. 
In  an  April  8,  1998,  conference  call  between  ACT,  AOS,  and  AUA, 
it  was  agreed  that  a  Data  Point  (DP)  should  be  added  in  the  Y2K 
software  build  to  keep  track  of  this  condition  and  cause  an  MPS 
alarm  when  an  adaptable  Good/Bad  QFB  ratio  threshold  is  exceeded. 
This  problem  was  classified  as  Major  and  remains  open.  (Refer  to 
PTR  OTE-058 . ) 

4.4.1.14.3.3  PTRs  Generated. 

See  appendix  B  for  the  complete  PTR  details.  The  PTRs  generated 
with  respect  to  this  test  are: 

Critical:  OTE-007  -  Closed 
OTE-012  -  Closed 
OTE-030  -  Closed 

Major:  OTE-008  -  Closed 

OTE-OIO  -  Closed 
OTE-013  -  Closed 
OTE-057  -  Closed 
OTE-058  -  Open 

Moderate:  OTE-055  -  Open 

4.4.1.15  Test  AL-10. 

The  objective  of  this  test  was  to  verify  particular  ALDARS  NAS- 
SS-1000  requirements  (see  appendix  A). 

In  order  to  meet  this  objective,  this  test  verified  that: 

a.  ADAS  stored  the  NLDN  lightning  data  (only  that  lightning 
information  contained  in  ADAS-generated  METAR  and  SPECI 
messages) . 

4.4.1.15.1  Description. 

This  scenario  involved  four  simulated  AWOSs.  Each  AWOS  simulator 
was  based  on  the  awos_std  sequence  file.  This  standard  AWOS 
sequence  file  was  modified  such  that  octet  57,  bit  0  was  set. 

This  bit  indicates  that  a  lightning  activity  SPECI  should  be 
generated.  Further  modification  of  the  standard  AWOS  sequence 
file  was  made  for  this  test  as  follows: 

AWOS  #1  -  At  minutes  1,  3,  5,  7,  9,  11,  13,  and  15,  octet  57, 
bit  7  (lightning  at  airport)  was  set.  This  indicated 
thunderstorm  begin  for  these  minutes.  At  minutes  2,  4,  6,  8,  10, 


52 


12,  14,  and  16,  none  of  the  bits  for  octet  57  or  58  were  set. 

This  indicated  thunderstorm  end  for  these  minutes. 

AWOS  #2  -  At  minutes  1,  3,  5,  7,  9,  11,  13,  and  15,  octet  57, 
bit  7  (lightning  in  vicinity  of  airport)  was  set.  This  indicated 
thunderstorm  begin  for  these  minutes.  At  minutes  2,  4,  6,  8,  10, 
12,  14,  and  16,  none  of  the  bits  for  octet  57  or  58  were  set. 

This  indicated  thunderstorm  end  for  these  minutes, 

AWOS  #3  -  This  simulator  was  varied  for  each  minute.  The 
following  are  the  details  for  each  minutes  activity: 

Minute  1  -  octet  58,  bit  0  was  set  indicating  the  N  sector 
received  a  lightning  strike. 

Minute  2  -  octet  58,  bit  1  was  set  indicating  the  NE  sector 
received  a  lightning  strike. 

Minute  3  -  octet  58,  bit  2  was. set  indicating  the  E  sector 
received  a  lightning  strike. 

Minute  4  -  octet  58,  bit  3  was  set  indicating  the  SE  sector 
received  a  lightning  strike. 

Minute  5  -  octet  58,  bit  4  was  set  indicating  the  S  sector 
received  a  lightning  strike. 

Minute  6  —  octet  58,  bit  5  was  set  indicating  the  SW  sector 
'  received  a  lightning  strike. 

Minute  7  -  octet  58,  bit  6  was  set  indicating  the  W  sector 
received  a  lightning  strike. 

Minute  8  -  octet  58,  bit  7  was  set  indicating  the  NW  sector 
received  a  lightning  strike. 

Minute  9  -  octet  57,  bit  6  was  set  indicating  that  zone  1 
received  a  lightning  strike  and  octet  58,  bit  0  was  set 
indicating  the  N  sector  received  a  lightning  strike. 

Minute  10  —  octet  57,  bit  6  was  set  indicating  that  zone  1 
received  a  lightning  strike  and  octet  58,  bit  1  was  set 
indicating  the  NE  sector  received  a  lightning  strike. 

Minute  11  —  octet  57,  bit  6  was  set  indicating  that  zone  1 
received  a  lightning  strike  and  octet  58,  bit  2  was  set 
indicating  the  E  sector  received  a  lightning  strike. 

Minute  12  —  octet  57,  bit  6  was  set  indicating  that  zone  1 
received  a  lightning  strike  and  octet  58,  bit  3  was  set 
indicating  the  SE  sector  received  a  lightning  strike. 

Minute  13  —  octet  57,  bit  7  was  set  indicating  that  zone  2 
received  a  lightning  strike  and  octet  58,'  bit  4  was  set 
indicating  the  S  sector  received  a  lightning  strike. 

Minute  14  —  octet  57,  bit  7  was  set  indicating  that  zone  2 
received  a  lightning  strike  and  octet  58,  bit  5  was  set 
indicating  the  SW  sector  received  a  lightning  strike. 

Minute  15  —  octet  57,  bit  7  was  set  indicating  that  zone  2 
received  a  lightning  strike  and  octet  58,  bit  6  was  set 
indicating  the  W  sector  received  a  lightning  strike. 

Minute  16  -  octet  57,  bit  7  was  set  indicating  that  zone  2 
received  a  lightning  strike  and  octet  58,  bit  7  was  set 
indicating  the  NW  sector  received  a  lightning  strike. 
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Also, 

Minutes  1  through  16-  octet  68,  bit  3  was  set  indicating 
Automated  Lightning  Remarks  were  present.  Octet  69 
indicated  the  appropriate  Automated  Lightning  Remark  to 
correspond  to  the  octet  58  bit  settings.  ... 

AWOS  #4  -  At  minutes  1,  4,  7,  and  10,  octet  14,  bit  0 
(Thunderstorm  Begin)  was  set.  At  minutes  2,  5,  8,  and  11,  octet 
14,  bit  1  (Thunderstorm  Increase)  was  set.  At  minutes  3,  6,  9, 
and  12,  octet. 14,  bit  2  (Thunderstorm  End)  was  set.  At  minute 
13,  14,  15,  and  16  all  bits  in  octet  57  and  58  were  set  to 
generate  the  TSNO  Auto  Remark.  For  each  minute,  also  Octet  57, 
bit  0  was  set  in  order  to  indicate  a  SPECI. 

4.4.1.15.2  Data  Reduction  and  Analysis  Method. 

Generated  METAR  message  archive  and  IPS  WMSCR  file: 

To  verify  that  the  lightning  data  was  -  stored  as  part  of  the 
generated  METAR  messages,  analysis  was  performed  on  the  archive 
file.  Comparison  of  the  IPS  WMSCR  METAR  file  contained  the  same 
messages. 

For  simulator  #1,  analysis  of  this  file  revealed  that  for  minutes 
1,  3,  5,  7,  9,  11,  13,  and  15,  a  "TS"  appeared  for  the  present 

weather  field.  For  minutes  2,  4,  6,  8,  10,  12,  .14,  and  16,  the 

"TS"  was  not  in  the  present  weather  field.  Additionally,  for 
each  minute  that  included  a  "TS",  there  was  a  TSBxx  added  to  the 
Auto  Remarks  field,  where  xx  was  the  actual  test  time  for  when 
the  thunderstorm  began.  Also,  for  each  minute  that  did  not 
include  a  "TS",  there  was  a  TSExx  added  to  the  Auto  Remarks 
field,  where  xx  was  the  actual  test  time  for  when  the 
thunderstorm  ended.  These  TSB  and  TSE  remarks  continued  to 
accumulate  for  the  duration  of  the  test. 

For  simulator  #2,  analysis  of  this  file  revealed  that  for  minutes 
1,  3,  5,  7,  9,  11,  13,  and  15,  a  "VCTS"  appeared  for  the  present 

weather  field.  For  minutes  2,  4,  6,  8,  10,  12,  14,  and  16,  the 

"VCTS"  was  not  in  the  present  weather  field.  Additionally,  for 
each  minute  that  included  a  "VCTS",  there  was  a  TSBxx  added  to 
the  Auto  Remarks  field,  where  xx  was  the  actual  test  time  for 
when  the  thunderstorm  began.  Also,  for  each  minute  that  did  not 
include  a  "VCTS",  there  was  a  TSExx  added  to  the  Auto  Remarks 
field,  where  xx  was  the  actual  test  time  for  when  the 
thunderstorm  ended.  These  TSB  and  TSE  remarks  continued  to 
accumulate  for  the  duration  of  the  test. 

For  simulator  #3,  analysis  of  this  file  revealed  that  for: 

minute  1  -  "LTG  DSNT  N"  appeared  for  the  Automated  Lightning 
Remark . 

minute  2  -  "LTG  DSNT  NE"  appeared  for  the  Automated 
Lightning  Remark. 


54 


minute  3  -  "LTG  DSNT  E"  appeared  for  the  Automated  Lightning 
Remark. 

minute  4  -  "LTG  DSNT  SE"  appeared  for  the  Automated 

Lightning  Remark.  . 

minute  5  -  "LTG  DSNT  S"  appeared  for  the  Automated  Lightning 

Remark.  . 

minute  6  -  "LTG  DSNT  SW"  appeared  for  the  Automated 

Lightning  Remark.  . 

minute  7  -  "LTG  DSNT  W"  appeared  for  the  Automated  Lightning 

Remark. 

minute  8  -  "LTG  DSNT  NW"  appeared  for  the  Automated 
Lightning  Remark. 

minute  9  -  "TS"  appeared  for  the  present  weather  field  and 

"LTG  DSNT  N"  in  the  Automated  Lightning  Remark. 

minute  10  -  "TS"  appeared  for  the  present  weather,  field  and 

"LTG  DSNT  NE"  in  the  Automated  Lightning  Remark. 

minute  11  -  "TS"  appeared  for  the  present  weather  field  and 

"LTG  DSNT  E"  in  the  Automated  Lightning  Remark. 

minute  12  -  "TS"  appeared  for  the  present  weather  field  and 

"LTG  DSNT  SE"  in  the  Automated  Lightning  Remark. 

minute  13  -  "VCTS"  appeared  for  the  present  weather  field 

and  "LTG  DSNT  S"  in  the  Automated  Lightning  Remark. 

minute  14  -  "VCTS"  appeared  for  the  present  weather  field 

and  "LTG  DSNT  SW"  in  the  Automated  Lightning  Remark. 

minute  15  -  "VCTS"  appeared  for  the  present  weather  field 

and  "LTG  DSNT  W"  in  the  Automated  Lightning  Remark. 

minute  16  -  "VCTS"  appeared  for  the  present  weather  field 

and  "LTG  DSNT  NW"  in  the  Automated  Lightning  Remark. 

For  simulator  #4,  analysis  of  this  file  revealed  that  for  minutes 
1,  4,  7,  and  10  of  this  scenario,  a  TSBxx  was  not  included  m  the 
Auto  Remarks  section.  For  minutes  2,  5,  8,  and  11,  a  TSIxx  was 
not  included  in  the  Auto  Remarks  section.  For  minutes  3,  6,  9, 
and  12  a  TSExx  was  not  included  in  the  Auto  Remarks  section.  The 
xx  represented  the  minute  the  SPECI  was  sent  out.  For  minutes 
13,  14,  15,  and  16,  a  TSNO  remark  was  generated. 

For  this  test,  two  out  of  two  Evaluation  Criteria  passed.  The 
Evaluation  Criteria  used  to  determine  that  this  test's 
requirements  were  verified  are  contained  in  appendix  C. 

4.4.1.15.3  Results  and  Discussion. 

4.4.1.15.3.1  Data . 

See  appendix  C  for  a  list  of  the  files  that  contain  the  test  data 
results  and  evaluation  criteria  CR  numbers  indicated  in  the  Data 
Reduction  and  Analysis  Method  section  above. 

4.4.1.15.3.2  Significant  Problems. 

a.  During  OT&E  #1,  it  was  discovered  that  ADAS  did  not 
generate  . a  TSNO  remark  in  the  Metar  message  when  all  octet  57  and 
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58  bits  were  set  (xff) .  This  problem  is  classified  as  Major. 

DME  implemented  a  software  fix  into  software  build  4.19.  This 
fix  was  tested  during  OT&E  #2  and  the  data  from  al-10-2.cap 
verified  that  this  problem  was  corrected.  This  PTR  has  been 
closed.  -  (Refer  to  PTR  OTE-039)  .  '  •" 

b.  PTR  OTE-040  was  generated,  during  OT&E  #1,  as  the  result 
of  an  error  in  the  sequence  file  that  was  used  for  this  test. 
Since  then  the  sequence  file  has  been  modified  and  the  test  ran 
during  OT&E  #2  without  a  problem.  This  PTR  has  been  closed. 
(Refer  to  PTR  OTE-040) . 

4.4.1.15.3.3  PTRs  Generated. 

See  appendix  B  for  the  complete  PTR  details.  The  PTRs  generated 
with  respect  to  this  test  are: 

Major:  OTE-039  -  Closed 
OTE-040  -  Closed 

4,4.1.16  Test  AL-11. 

The  objective  of  this  test  was  to  verify  particular  ALDARS  NAS- 
SS-1000  requirements  (see  appendix  A). 

In  order  to  meet  this  objective,  this  test  verified  that: 

a.  ADAS  could  process  the  quality  factor  bit  received  as 
part  of  the  NLDN  LDD  data. 

4.4.1.16.1  Description. 

This  scenario  involved  one  simulated  AWOS .  The  IPS  sent  flash 
records  that  fell  into  various  AWOS  zones/sectors.  The  scenario 
was  repeated  twice.  The  first  time  all  the  flash  records 
contained  a  "good"  quality  factor  bit.  The  second  time  all  the 
flash  records  contained  a  "bad"  quality  factor  bit. 

4.4.1.16.2  Data  Reduction  and  Analysis  Method. 

The  following  analysis  was  performed  for  the  data  collected. 

LAD  messages : 

The  LAD  messages  were  logged  on  the  IPS  as  part  of  the  AWOS 
incoming  message  log.  Analysis  of  the  LAD  messages  sent 
indicated  that  for: 

minute  2,  a  flash  occurred  in  zone  1;  / 

minute  3,  a  flash  occurred  in  zone  1  and  2; 

minute  4,  a  flash  occurred  in  zones  1  and  2  and  sector  1; 

minute  5,  a  flash  occurred  in  zones  1  and  2  and  sectors  1 

and  2; 
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minute  6,  a  flash  occurred  in  zones  1  and  2  and  sectors  1, 
2 ,  and  3; 

minute  7 ,  a  flash  occurred  in  zones  1  and  2  and  sectors  1, 
2 ,  3 ,  and  4 ; 

minute  8,  a  flash  occurred  in  zones  1  and  2  and  sectors  1, 
2,3,  4 ,  and  5; 

minute  9,  a  flash  occurred  in  zones  1  and  2  and  sectors  1, 


2,  3,  4,  5,  and  6; 
minute  10,  a  flash  occurred  in 
2,  3,  4,  5,  6,  and  7; 

minute  11,  a  flash  occurred  in 
2,  3,  4,  5,  6,  7,  and  8; 

minute  12,  a  flash  occurred  in 
2,  3,  4,5,  6,  7,  and  8 ; 
minute  13,  a  flash  occurred  in 
2,3,  4,  5,  6,  7,  and  8; 
minute  14,  a  flash  occurred  in 
2,  3,  4,  5,  6,  7,  and  8; 

minute  15,  a  flash  occurred  in 
2,  3,  4,  5,  6,  7,  and  8; 

minute  16,  a  flash  occurred  in 
2,  3,  4,  5,  6,  7,  and  8  ; 

minute  17,  a  flash  occurred  in 
4,  5,  6,  7,  and  8; 
minute  18,  a  flash  occurred  in 
and  8  ; 

minute  19,  a  flash  occurred  in 


zones  1  and  2  and  sectors  1, 
zones  1  and  2  and  sectors  1, 
zones  1  and  2  and  sectors  1, 
zones  1  and  2  and  sectors  1, 
zones  1  and  2  and  sectors  1, 
zones  1  and  2  and  sectors  1, 
zones  1  and  2  and  sectors  1, 
zone  2  and  sectors  1,  2,  3, 
sectors  1,  2,  3,  4,  5,  6,  7, 
sectors  2,  3,  4,  5,  6,  7,  and 
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minute  20,  a  flash  occurred  in  sectors  3,  4,  5,  6,  7,  and  8; 

minute  21,  a  flash  occurred  in  sectors  4,  5,  6,  7,  and  8; 

minute  22,  a  flash  occurred  in  sectors  5,  6,  7,  and  8; 

minute  23,  a  flash  occurred  in  sectors  6,  7,  and  8; 

minute  24,  a  flash  occurred  in  sectors  7,  and  8; 
minute  25,  a  flash  occurred  in  sector  8; 

minutes  26  through  28  contained  no  indications  of  flashes  as 
a  result  of  the  "bad"  quality  factor  bit. 


For  the  ITWS; 

The  LDD  messages  were  logged  on  the  IPS  for  each  ITWS  as  part  of 
their  incoming  message  log.  Analysis  of  the  ITWS's  LDD  messages 
indicated  that  each  of  the  lightning  flash  records  were  passed 
along  from  minutes  1  to  10  and  minutes  18  to  27.  Since  NO 
quality  factor  bit  screening  is  performed  for  LDD  messages  to 
ITWS,  the  flash  records  for  minutes  18  to  27  were  also  passed 
along.  As  a  result  the  LDD  indicated  for: 

minute  1,  a  flash  occurred  in  zone  1. 

minute  2,  a  flash  occurred  in  zone  2; 

minute  3,  a  flash  occurred  in  sector  1; 

minute  4,  a  flash  occurred  in  sector  2; 

minute  5,  a  flash  occurred  in  sector  3; 

minute  6,  a  flash  occurred  in  sector  4; 
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minute  7 ,  a  flash  occurred  in  sector  5; 

minute  8,  a  flash  occurred  in  sector  6; 

minute  9,  a  flash  occurred  in  sector  7; 

minute  10,  a  flash  occurred  in  sector  8; 

minute  18,  a  flash  occurred  in  zone  1 . 

minute  19,  a  flash  occurred  in  zone  2; 

minute  20,  a  flash  occurred  in  sector  1; 

minute  21,  a  flash  occurred  in  sector  2; 

minute  22,  a  flash  occurred  in  sector  3; 

minute  23,  a  flash  occurred  in  sector  4; 

minute  24,  a  flash  occurred  in  sector  5; 

minute  25,  a  flash  occurred  in  sector  6; 

minute  26,  a  flash  occurred  in  sector  7/ 

minute  27,  a  flash  occurred  in  sector  8; 

For  this  test,  three  out  of  three  Evaluation  Criteria  passed. 

The  Evaluation  Criteria  used  to  determine  that  this  test's 
requirements  were  verified  are  contained  in  appendix  C. 

4.4.1.16.3  Results  and  Discussion. 

4.4.1.16.3.1  Data . 

See  appendix  C  for  a  list  of  the  files  that  contain  the  test  data 
results  and  evaluation  criteria  CR  numbers  indicated  in  the  Data 
Reduction  and  Analysis  Method  s'ection  above. 

4.4.1.16.3.2  Significant  Problems. 

None 

4.4.1.16.3.3  PTRs  Generated. 

None 

4.4.2  Category  DE  -  Degraded  Operation  Tests. 

4. 4. 2.1  Test  DE-01. 

The  objective  of  ADAS/ALDARS  Regression  Test  DE-01  was  to  verify 
ADAS  functionality  was  not  adversely  impacted  by  the  ALDARS 
contact  modifications  to  the  previously  baselined  version  of  the 
ADAS  software.  The  functionality  verifies  that:  (1)  if  there  is 
a  communications  failure  with  any  of  the  configured  AWOS/ASOS 
sites  in  the  Initialization  State,  then  ADAS  indicates  it  is  in 
REDUCED  mode  when  it  reaches  the  Operational  State;  and  that, 

(2)  ADAS  detects  when  the  AWOS/ASOS  site  becomes  available, 
re-establishes  communications  with  the  MPS,  and  switches  to  FULL 
mode . 
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4. 4. 2. 1.1  Description. 

The  IPS  test  started  with  all  but  one  AWOS  simulators  enabled. 

The  ADAS  system  started  and  during  the  initialization  phase 
detected  the  AWOS  station  that  was  off-line.  ADAS  continued  to 
the  operational  state,  running  in  'Reduced'  Mode.  The  MPS 
requested  the  RMS  Master  Data  Point  sys_mode  to  record  the  System 
Mode  state  (reduced/full).  The  IPS  system  enabled; the  AWOS 
station  and  ADAS  switched  to  Full  Mode.  The  MPS  simulator 
retrieved  the  RMS  Master  Data  Point  sys_mode.  IPS  prompted  the 
test  operator  to  report  event  type  10  event  log  entries.  The 
test  terminated  when  the  t^st  operator  acknowledged  the  IPS 
prompt . 

4. 4. 2. 1.2  Data  Reduction  and  Analysis  Method. 

Test  DE-01's  relevant  OT&E  formal  test  run  data  has  been 
incorporated  into  its  TCF  and  marked  with  the  evaluation _ criteria 
cross  reference  numbers.  The  evaluation  criteria,  modified  to 
past-tense,  and  the  cross-referenced  test  data  from  DE-01 's  TCF 
are  included  below  in  this  report.  See  appendix  C  paragraph  for 
test  DE-01  for  the  completed  TCF  procedure  steps. 

For  this  test,  four  out  of  four  Evaluation  Criteria  passed.  The 
Evaluation  Criteria  used  to  determine  that  this  test's 
requirements  were  verified  are  contained  in  appendix  C. 

4. 4. 2. 1.3  Results  and  Discussion. 

The  following  paragraphs:  contain  cross-reference  formal  test 
data;  provide  details  of  significant  problems  encountered  during 
test  execution;  and  list  the  status  of  OT&E  PTRs  generated  wit 
respect  to  test  DE-01. 

4 . 4 ♦ 2 . 1 . 3 , 1  Data . 

Due  to  the  volume  of  the  cross-referenced  test  data,  .it  has  not 
been  included  in  this  paragraph.  The  data  has  been  included  in 
the  appendix  C  paragraph  associated  with  test  DE-01. 

4. 4. 2. 1.3. 2  Significant  Problems.  ■ 

None 

4. 4. 2 .1.3. 3  PTRs  Generated . 

None 

4. 4. 2. 2  Test  DE-02. 

The  objective  of  ADAS/ALDARS  Regression  Test  DE-02  was  to  verify 
ADAS  functionality  was  not  adversely  impacted  by  the  ALDARS 
contract  modifications  to  the  previously  baselined  version  of  the 
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ADAS  software.  This  functionality  test  verifies  that:  (1)  if  - 
there  is  a  communications  failure  with  MPS  in  the  Initialization 
State,  then  ADAS  is  in  REDUCED  mode  when  it  reaches  the 
Operational  State;  and  (2)  ADAS  detects  when  the  MPS  becomes 
available,  re-establishes  communications  with  the  MPS,  and  sets 
the  sysjmode  datapoint  to  FULL. 

4. 4. 2. 2.1  Description. 

The  IPS  test  started  with  the  MPS  simulator  disabled.  The  ADAS 
system  was  started  and  during  the  initialization  phase  detected 
MPS  was  not  available.  ADAS  set  the  sys_mode  datapoint  to 
REDUCED  and  continued  to  the  Operational  State.  An  IPS  event 
instructed  the  Test  Operator  to  log  into  the  ASC,  display  the  RMS 
Master  Data  Point  Group,  press  printscreen,  logout,  and 
acknowledge  the  IPS  message.  After  the  operator  acknowledged  the 
IPS  event,  the  MPS  simulator  was  enabled  and  ADAS  switched  to 
Full  Mode.  The  MPS  Simulator  requested  the  RMS  Master  Data  Point 
sys_mode.  The  IPS  instructed  the  Test  Operator  to  login  the  ASC, 
request  a  Event  Log  Report  for  event  type  7,  logout,  and 
acknowledge  the  IPS  prompt.  After  the  operator  acknowledged  the 
second  IPS  event,  the  IPS  test  was  terminated. 

4. 4. 2. 2. 2  Data  Reduction  and  Analysis  Method. 

Test  DE-02' s  relevant  OT&E  formal  test  run  data  has  been 
incorporated  into  its  TCF  and  marked  with  the  evaluation  criteria 
cross  reference  numbers.  The  evaluation  criteria,  modified  to 
past-tense,  and  the  cross-referenced  test  data  from  DE-02's  TCF 
are  included  below  in  this  report.  See  appendix  C  paragraph  for 
test  DE-02  for  the  completed  TCF  procedure  steps. 

For  this  test,  four  out  of  four  Evaluation  Criteria  passed.  The 
Evaluation  Criteria  used  to  determine  that  this  test's 
requirements  were  verified  are  contained  in  appendix  C. 

4. 4. 2. 2. 3  Results  and  Discussion. 

The  following  paragraphs:  contain  cross-reference  formal  test 
data;  provide  details  of  significant  problems  encountered  during 
test  execution;  and  list  the  status  of  OT&E  PTRs  generated  with 
respect  to  test  DE-02. 

4. 4. 2. 2. 3.1  Data. 

Due  to  the  volume  of  the  cross-referenced  test  data,  it  has  not 
been  included  in  this  paragraph.  The  data  has  been  included  in 
the  appendix  C  paragraph  associated  with  test  DE-02. 

4. 4. 2. 2. 3. 2  Significant  Problems. 

None 
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4. 4. 2. 2. 3. 3  PTRs  Generated. 

None 

4. 4. 2. 3  Test  DE-03. 

The  objective  of  ADAS/ALDARS  Regression  Test  DE-03  was  to  verify 
ADAS  functionality  was  not  adversely  impacted  by  the  ALDARS 
contract  modifications  to  the  previously  baselined  version  of  the 
ADAS  software.  This  functionality  test  verifies  that:.  (1)  if 
there  is  a  communications  failure  with  DLP  in  the  Initialization 
State,  then  ADAS  is  in  REDUCED  mode  when  it  reaches  the 
Operational  State;  and  (2)  ADAS  detects  when  the  DLP  becomes 
available,  establishes  communications  with  the  DLP,  and  switches 
to  FULL  mode . 

4. 4. 2. 3.1  Description. 

The  IPS  test  was  started  with  the  DLP  simulator  disabled.  The 
ADAS  system  started  and  during  the  initialization  phase  detected 
DLP  was  unavailable.  ADAS  continued  to  the  Operational  State, 
running  in  Reduced  Mode.  The  MPS  then  requested  RMS  Master 
System  Mode  Data  Point.  The  IPS  then  enabled  the  DLP  simulator 
and  ADAS  switched  to  Full  Mode.  The  IPS  prompted  the  operator  to 
login  to  the  ASC,  request  an  event  log  report  for  event  type  1, 
logoff  the  ASC,  and  acknowledge  the  prompt.  When  the  prompt  was 
acknowledged,  the  IPS  terminated  the  test. 

4. 4. 2. 3. 2  Data  Reduction  and  Analysis  Method. 

Test  DE-03' s  relevant  OT&E  formal  test  run  data  has  been 
incorporated  into  its  TCF  and  marked  with  the  evaluation  criteria 
cross  reference  numbers.  The  evaluation  criteria,  modified  to 
past-tense,  and  the  cross-referenced  test  data  from  DE-03' s  TCF 
are  included  below  in  this  report.  See  appendix  C  paragraph  for 
test  DE-03  for  the  completed  TCF  procedure  steps. 

For  this  test,  four  out  of  four  Evaluation  Criteria  passed.  The 
Evaluation  Criteria  used  to  determine  that  this  test's 
requirements  were  verified  are  contained  in  appendix  C. 

4. 4. 2. 3. 3  Results  and  Discussion. 

The  following  paragraphs:  contain  cross-reference  formal  test ^ 
data;  provide  details  of  significant  problems  encountered  during 
test  execution;  and  list  the  status  of  OT&E  PTRs  generated  with 
respect  to  test  DE-03. 

4 . 4 . 2 . 3 . 3 . 1  Data . 

Due  to  the  volume  of  the  cross-referenced  test  data,  it  has  not 
been  included  in  this  paragraph.  The  data  has  been  included  in 
the  appendix  C  paragraph  associated  with  test  DE-03. 
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4. 4. 2. 3. 3. 2  Significant  Problems . 

None 

4. 4. 2. 3. 3.3  PTRs  Generated. 

None 

4. 4. 2. 4  Test  DE-04. 

The  objective  of  ADAS/ALDARS  Regression  Test  DE-04  was  to  verify 
ADAS  functionality  was  not  adversely  impacted  by  the  ALDARS 
contract  modifications  to  the  previously  baselined  version  of  the 
ADAS  software.  This  functionality  test  verifies  that:  (1)  if 
there  is  a  communications  failure  with  WARP  in  the  Initialization 
State,  then  ADAS  is  in  REDUCED  mode  when  it  reaches  the 
Operational  State;  and  (2)  ADAS  detects  when  the  WARP  becomes 
available,  re-establishes  communications  with  the  WARP,  and 
switches  to  FULL  mode. 

4. 4. 2. 4.1  Description. 

The  IPS  test  started  with  the  WARP  simulator  disabled.  The  ADAS 
system  started  and  during  the  initialization  phase  detected  WARP 
was  not  available.  ADAS  continued  to  the  Operational  State, 
running  in  Reduce  Mode.  The  MPS  requested  RMS  Master  System  Mode 
Data  Point.  The  IPS  then  enabled  the  WARP  simulator,  ADAS 
detected  the  availability  of  WARP  and  switched  to  Full  Mode.  The 
operator  was  prompted  to  login,  request  an  event  log  report  for 
event  type  1,  logout,  and  acknowledge  the  IPS  prompt.  When  the 
prompt  was  acknowledged,  the  IPS  terminated  the  test. 

4. 4. 2. 4. 2  Data  Reduction  and  Analysis  Method. 

Test  DE-04 's  relevant  OT&E  formal  test  run  data  has  been 
incorporated  into  its  TCF  and  marked  with  the  evaluation  criteria 
cross  reference  numbers.  The  evaluation  criteria,  modified  to 
past-tense,  and  the  cross-referenced  test  data  from  DE-04' s  TCF 
are  included  below  in  this  report.  See  appendix  C  paragraph  for 
test  DE-04  for  the  completed  TCF  procedure  steps. 

For  this  test,  four  out  of  four  Evaluation  Criteria  passed.  The 
Evaluation  Criteria  used  to  determine  that  this  test's 
requirements  were  verified  are  contained  in  appendix  C. 

4. 4. 2. 4. 3  Results  and  Discussion. 

The  following  paragraphs:  contain  cross-reference  formal  test 
data;  provide  details  of  significant  problems  encountered  during 
test  execution;  and  list  the  status  of  OT&E  PTRs  generated  with 
respect  to  test  DE-04. 
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4 . 4 . 2 . 4 . 3 . 1  Data . 


Due  to  the  volume  of  the  cross-referenced  test  data,  it  has  not 
been  included  in  this  paragraph.  The  data  has  been  included  in 
the  appendix  C  paragraph  associated  with  test  DE-04. 

4. 4. 2. 4. 3. 2  Significant  Problems. 

None 

4. 4. 2. 4. 3. 3  PTRs  Generated. 

None 

4. 4. 2. 5  Test  DE-05. 

The  objective  of  ADAS/ALDARS  Regression  Test  DE-05  was  to  verify 
ADAS  functionality  was  not  adversely  impacted  by  the  ALDARS 
contract  modifications  to  the  previously  baselined  version  of  the 
ADAS  software.  This  functionality  test  verifies  that:  (1)  if 

there  is  a  communications  failure  with  WMSCR  in  the 
Initialization  State,  then  ADAS  is  in  REDUCED  mode  when  it 
reaches  the  Operational  State;  and  (2)  ADAS  detects  when  the 
WMSCR  becomes  available,  re-establishes  communications  with  the 
WMSCR,  and  switches  to  FULL  mode. 

4. 4. 2. 5.1  Description. 

The  IPS  test  started  with  the  WMSCR  simulator  disabled.  The  ADAS 
system  started  and  during  the  initialization  phase  detected  WMSCR 
was  unavailable.  ADAS  continued  to  the  Operational  State, 
running  in  Reduced  Mode.  The  MPS  requested  the  RMS  Master  System 
Mode  DP,  then  the  IPS  will  enable  the  WMSCR  simulator.  ADAS 
detected  the  availability  of  the  WMSCR,  established 
communications,  and  switched  to  System  Mode  Full.  The  IPS 
prompted  the  operator  to  login,  request  an  event  log  report  for 
event  type  12,  logout,  and  acknowledge  the  prompt.  When 
acknowledged,  the  IPS  terminated  the  test. 

4. 4. 2. 5. 2  Data  Reduction  and  Analysis  Method. 

Test  DE-05 ' s  relevant  OT&E  formal  test  run  data  has  been 
incorporated  into  its  TCF  and  marked  with  the  evaluation  criteria 
cross  reference  numbers.  The  evaluation  criteria,  modified  to 
past-tense,  and  the  cross-referenced  test  data  from  DE-05 's  TCF 
are  included  below  in  this  report.  See  appendix  C  paragraph  for 
test  DE-05  for  the  completed  TCF  procedure  steps. 

For  this  test,  four  out  of  four  Evaluation  Criteria  passed.  The 
Evaluation  Criteria  used  to  determine  that  this  test's 
requirements  were  verified  are  contained  in  appendix  C. 


63 


4. 4. 2. 5. 3  Results  and  Discussion . 

The  following  paragraphs:  contain  cross-reference  formal  test 
data;  provide  details  of  significant  problems  encountered  during 
test  execution;  and  list  the  status  of  OT&E  PTRs  generated  with 
respect  to  test  DE-05. 

4 . 4 . 2 . 5 . 3 . 1  Data . 

Due  to  the  volume  of  the  cross-referenced  test  data,  it  has  not 
been  included  in  this  paragraph.  The  data  has  been  included  in 
the  appendix  C  paragraph  associated  with  test  DE-05. 

4. 4. 2. 5. 3. 2  Significant  Problems. 

None 

4. 4. 2. 5. 3. 3  PTRs  Generated. 

None 

4. 4. 2, 6  Test  DE-06. 

The  objective  of  ADAS/ALDARS  Regression  Test  DE-06  was  to  verify 
ADAS  functionality  was  not  adversely  impacted  by  the  ALDARS 
contract  modifications  to  the  previously  baselined  version  of  the 
ADAS  software.  This  functionality  test  verifies  that:  (1)  if 
there  is  a  communications  failure  with  CTS  in  the  Initialization 
State,  then  ADAS  is  in  REDUCED  mode  when  it  reaches  the 
Operational  State;  and  (2)  ADAS  detects  when  the  CTS  becomes 
available,  re-establishes  communications  with  the  CTS,  and 
switches  to  FULL  mode. 

4. 4. 2. 6.1  Description. 

The  IPS  test  started  with  the  CTS  simulator  disabled.  The  ADAS  ' 
system  started  and  during  the  initialization  phase  detected  CTS 
was  unavailable.  ADAS  continued  to  the  Operational  State, 
running  in  Reduce  Mode.  The  MPS  requested  the  RMS  Master  System 
Mode  Data  Point,  then  the  CTS  simulator  was  enabled.  ADAS 
detected  the  incoming  CTS  signal  and  switched  to  System  Mode 
Full.  The  IPS  prompted  the  test  operator  to  login,  request  an 
event  log  report  for  event  type  10,  logout,  and  acknowledged  the 
prompt.  When  the  prompt  was  acknowledged,  the  IPS  terminated  the 
test. 

4.4.2. 6.2  Data  Reduction  and  Analysis  Method . 

Test  DE-06 's  relevant  OT&E  formal  test  run  data  has  been 
incorporated  into  its  TCF  and  marked  with  the  evaluation  criteria 
cross  reference  numbers.  The  evaluation  criteria,  modified  to 
past-tense,  and  the  cross-referenced  test  data  from  DE-06 's  TCF 
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are  included  below  in  this  report.  See  appendix  C  paragraph  for 
test  DE-06  for  the  completed  TCF  procedure  steps. 

For  this  test,  four  out  of  four  Evaluation  Criteria  passed.  The 
Evaluation  Criteria  used  to  determine  that  this  test' s 
requirements  were  verified  are  contained  in  appendix  C. 

4. 4. 2. 6. 3  Results  and  Discussion. 

The  following  paragraphs:  contain  cross-reference  formal  test, 
data;  provide  details  of  significant  problems  encountered  during 
test  execution;  and  list  the  status  of  OT&E  PTRs  generated  with 
respect  to  test  DE-06. 

4 . 4 . 2 . 6 . 3 . 1  Data . 

Due  to  the  volume  of  the  cross-referenced  test  data,  it  has  not 
been  included  in  this  paragraph.  The  data  has  been  included  in 
the  appendix  C  paragraph  associated  with  test  DE-06. 

4.4.2. 6.3.2  Significant  Problems. 

None 

4. 4. 2. 6. 3. 3  PTRs  Generated. 

None 

4. 4. 2. 7  Test  DE-07. 

The  objective  of  ADAS/ALDARS  Regression  Test  DE-07  was  to  verify 
ADAS  functionality  was  not  adversely  impacted  by  the  ALDARS 
contract  modifications  to  the  previously  baselined  version. of  the 
ADAS  software.  This  functionality  test  verifies  ADAS ' s  ability 
to  handle  communications  errors  on  the  MPS  link. 

4. 4. 2. 7.1  Description. 

Verification  was  achieved  by  having  the  MPS  simulator  make  a 
Subsystem  Status  request,  and  established  the  MPS  link  was  up 
when  ADAS  responded  to  the  request.  After  the  response. was 
returned,  the  MPS  simulator  disabled  communications,  waited  for  2 
minutes,  then  re-enabled  communications.  Two  additional  minutes 
of  run  time  established  that  MPS  communications  had  returned  to 
normal . 

4. 4. 2. 7. 2  Data  Reduction  and  Analysis  Method. 

Test  DE-07' s  relevant  OT&E  formal  test  run  data  has  been 
incorporated  into  its  TCF  and  marked  with  the  evaluation . criteria 
cross  reference  numbers.  The  evaluation  criteria,  modified  to 
past-tense,  and  the  cross-referenced  test  data  from  DE-07 's  TCF 
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are  included  below  in  this  report.  See  appendix  C  paragraph  for' 
test  DE-07  for  the  completed  TCF  procedure  steps. 

For  this  test,  four  out  of  four  Evaluation  Criteria  passed.  The 
Evaluation  Criteria  used  to  determine  that  this  test's 
requirements  were  verified  are  contained  in  appendix  C. 

4. 4. 2. 7. 3  Results  and  Discussion. 

The  following  paragraphs:  contain  cross-reference  formal  test 
data;  provide  details  of  significant  problems  encountered  during 
test  execution;  and  list  the  status  of  OT&E  PTRs  generated  with 
respect  to  test  DE-07. 

4. 4. 2. 7. 3.1  Data. 

Due  to  the  volume  of  the  cross-referenced  test  data,  it  has  not 
been  included  in  this  paragraph.  The  data  has  been  included  in 
the  appendix  C  paragraph  associated  with  test  DE-07. 

4.4.2-.  7,3.2  Significant  Problems. 

None 

4. 4. 2. 7. 3. 3  PTRs  Generated. 

None 

4. 4. 2. 8  Test  DE-08. 

The  objective  of  ADAS/ALDARS  Regression  Test  DE-08  was  to  verify 
ADAS  functionality  was  not  adversely  impacted  by  the  ALDARS 
contract  modifications  to  the  previously  baselined  version  of  the 
ADAS  software.  This  functionality  test  verifies  ADAS ’ s  ability 
to  handle  communications  errors  on  the  WARP  and  DLP  links. 

4. 4. 2. 8.1  Description . 

Verification  was  achieved  by  first  operating  normally  for  1 
minute.  This  established  that  the  links  were  up  and  running. 
Then,  the  DLP  and  WARP  simulators  disabled  communications,  waited 
2  minutes,  then  re-enabled  communications.  Two  additional 
minutes  of  run  time  established  that  communications  had  returned 
to  normal . 

4. 4. 2. 8. 2  Data  Reduction  and  Analysis  Method. 

Test  DE-08 's  relevant  OT&E  formal  test  run  data  has  been 
incorporated  into  its  TCF  and  marked  with  the  evaluation  criteria 
cross  reference  numbers.  The  evaluation  criteria,  modified  to 
past-tense,  and  the  cross-referenced  test  data  from  DE-08 's  TCF 
are  included  below  in  this  report.  See  appendix  C  paragraph  for 
test  DE-08  for  the  completed  TCF  procedure  steps. 
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For  this  test,  four  out  of  four  Evaluation  Criteria  passed.  The 
Evaluation  Criteria  used  to  determine  that  this  test's 
requirements  were  verified  are  contained  in  appendix  C. 

4. 4. 2. 8. 3  Results  and  Discussion. 

The  following  paragraphs:  contain  cross-reference  formal  test, 
data;  provide  details  of  significant  problems  encountered  during 
test  execution;  and  list  the  status  of  OT&E  PTRs  generated  with 
respect  to  test  DE-08. 

4 . 4 . 2 . 8 . 3 . 1  Data . 

Due  to  the  volume  of  the  cross-referenced  test  data,  it  has  not 
been  included  in  this  paragraph.  The  data  has  been  included  in 
the  appendix  C,  ’DE-08'  section. 

4. 4. 2. 8. 3. 2  Significant  Problems. 

None 

4. 4. 2. 8. 3. 3  PTRs  Generated. 

None 

4. 4. 2. 9  Test  DE-10. 

The  objective  of  ADAS/ALDARS  Regression  Test  DE-10  was  to  verify 
ADAS  functionality  was  not  adversely  impacted  by  the  ALDARS 
contract  modifications  to  the  previously  baselined  version  of  the 
ADAS  software.  This  functionality  test  verifies  ADAS ’ s : 

(1)  time  keeping  while  the  CTS  link  is  down;  and  (2)  time 
adjustment  when  the  CTS  link  is  reconnected. 

.4, 4. 2. 9.1  Description . 

Verification  was  achieved  by  running  normally  for  1  H  minutes  to 
synchronize  CTS  (IPS)  and  ADAS,  then  the  test  operator  was 
prompted  by  the  IPS  to  manually  disconnects  the  CTS  cable  using 
the  Patch  Panel  and  acknowledge  the  prompt.  After  the 
acknowledgement,  the  IPS  advanced  the  test  time  5  minutes  ahead, 
waited  60  seconds,  then  prompted  the  operator  to  reconnect  the 
CTS.  The  reception  of  the  re-enabled  CTS  signal  was  detected  by 
ADAS,  as  was  the  difference  between  the  CTS  time  and  the  ADAS 
unix  system  time.  The  ADAS  adjusted  the  unix  system  time  to 
match  the  time  received  from  the  CTS,  and  set  the  System  Mode  to 
Full.  The  IPS  waited  for  2  minutes  then  prompted  the  operator  to 
login,  request  a  report  for  event  type  9  and  10,  logout,  and 
acknowledge  the  prompt.  When  the  prompt  was  acknowledged,  the 
IPS  terminated  the  test. 
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4. 4. 2. 9. 2  Data  Reduction  and  Analysis  Method . 

Test  DE-10's  relevant  OT&E  formal  test  run  data  has  been 
incorporated  into  its  TCF  and  marked  with  the  evaluation  criteria 
cross  reference  numbers.  The  evaluation  criteria,  modified  to 
past-tense,  and  the  cross-referenced  test  data  from  DE-lO’s  TCF 
are  included  below  in  this  report.  See  appendix  C  paragraph  for 
test  DE-10  for  the  completed  TCF  procedure  steps. 

For  this  test,  four  out  of  four  Evaluation  Criteria  passed.  The 
Evaluation  Criteria  used  to  determine  that  this  test's 
requirements  were  verified  are  contained  in  appendix  C. 

4. 4. 2. 9. 3  Results  and  Discussion . 

The  following  paragraphs:  contain  cross-reference  formal  test 
data;  provide  details  of  significant  problems  encountered  during 
test  execution;  and  list  the  status  of  OT&E  PTRs  generated  with 
respect  to  test  DE-10. 

4. 4. 2. 9. 3.1  Data . 

Due  to  the  volume  of  the  cross-referenced  test  data,  it  has  not 
been  included  in  this  paragraph.  The  data  has  been  included  in 
the  appendix  C  paragraph  associated  with  test  DE-10. 

4. 4. 2. 9. 3. 2  Significant  Problems. 

None 

4. 4. 2. 9. 3.3  PTRs  Generated . 

None 

4.4.2.10  Test  DE-14. 

The  objective  of  ADAS/ALDARS  Regression  Test  DE-14  was  to  verify 
ADAS  functionality  was  not  adversely  impacted  by  the  ALDARS 
contract  modifications  to  the  previously  baselined  version  of  the 
ADAS  software.  This  functionality  test  verifies  ADAS  properly 
reports  external  error  conditions. 

4.4.2.10.1  Description. 

Verification  was  achieved  by  generating  three  events  and 
monitoring  their  responses.  The  first  event  was  generated  by 
removing  the  write  permissions  from  the  Adaptation  Parameter 
file,  "/usr/adas/adasrun/data/  SS/adb_env_prm" ,  and  attempting  to 
permanently  store  a  new  version  of  the  parameters  -  resulting  in 
a  file  error.  The  second  event  was  generated  by  an  AWOS 
simulator,  every  third  AWOS  messages  sent  to  ADAS  had  a  timestamp 
that  was  30  minutes.  The  MPS  simulator  generated  the  third  event 
by  sending  erroneous  data  command  requests  to  ADAS.  After 
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generation  of  the  second  event,  the  test  operator  logged  in,  _ 
reset  all  data  points  then  logged  off.  The  Test  Operator  waited 
for  the  second  Erroneous  Message  Event  (the  third  generated 
event)  to  be  printed,  and  noted  that  no  event  notification  was 
generated  at  the  ASC.  The  Test  Operator  then  logged  into  the 
ASC,  requested  a  report  for  event  types  21  and  43,  logged  out, 
and  acknowledge  the  IPS  event.  When  the  prompt  was  acknowledged, 
the  IPS  terminated  the  test. 

4.4.2.10.2  Data  Reduction  and  Analysis  Method. 

Test  DE-14 's  relevant  OT&E  formal  test  run  data  has  been 
incorporated  into  its  TCF  and  marked  with  the  evaluation  criteria 
cross  reference  numbers.  The  evaluation  criteria,  modified  to 
past-tense,  and  the  cross-referenced  test  data  from  DE-14's  TCF 
are  included  below  in  this  report.  See  appendix  C  paragraph  for 
test  DE-14  for  the  completed  TCF  procedure  steps. 

For  this  test,  five  out  of  five  Evaluation  Criteria  passed.  The 
Evaluation  Criteria  used  to  determine  that  this  test's 
requirements  were  verified  are  contained  in  appendix  C. 

4.4.2.10.3  Results  and  Discussion. 

The  following  paragraphs:  contain  cross-reference  formal  test, 
data;  provide  details  of  significant  problems  encountered  during 
test  execution;  and  list  the  status  of  OT&E  PTRs  generated  with 
respect  to  test  DE-14. 

4.4.2.10.3.1  Data. 

Due  to  the  volume  of  the  cross-referenced  test  data,  it  has  not 
been  included  in  this  paragraph.  The  data  has  been  included  in 
the  appendix  C  paragraph  associated  with  test  DE-14. 

4.4.2.10.3.2  Significant  Problems. 

None 

4.4.2.10.3.3  PTRs  Generated. 

None 

4.4.2.11  Test  DE-15. 

The  objective  of  ADAS/ALDARS  Regression  Test  DE-15  was  to  verify 
ADAS  functionality  was  not  adversely  impacted  by  the  ALDARS 
contract  modifications  to  the  previously  baselined  version  of  the 
ADAS  software.  This  functionality  test  verifies  ADAS  reports  CTS 
error  conditions. 
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4.4.2.11.1  Description. 

Verification  was  achieved  using  the  CTS  simulator  to  send  invalid 
data  for  a  period  of  at  least  3  seconds.  This  produced  at  least 
three  events  indicating  a  CTS  error  had  occurred.  Next  the  CTS 
simulator  disabled  and  re-enabled  communications  three  times. 

This  produced  six  CTS  status  change  events. 

4.4.2.11.2  Data  Reduction  and  Arialysis  Method. 

Test  DE-15' s  relevant  OT&E  formal  test  run  data  has  been 
incorporated  into  its  TCF  and  marked  with  the  evaluation  criteria 
cross  reference  numbers.  The  evaluation  criteria,  modified  to 
past-tense,  and  the  cross-referenced  test  data  from  DE-15's  TCF 
are  included  below  in  this  report.  .  See  appendix  C  paragraph  for 
test  DE-15  for  the  completed  TCF  procedure  steps. 

For  this  test,  three  out  of  three  Evaluation  Criteria  passed. 

The  Evaluation  Criteria  used  to  determine  that  this  test's 
requirements  were  verified  are  contained  in  appendix  C. 

4.4.2.11.3  Results  and  Discussion . 

The  following  paragraphs:  contain  cross-reference  formal  test 
data;  provide  details  of  significant  problems  encountered  during 
test  execution;  and  list  the  status  of  OT&E  PTRs  generated  with 
respect  to  test  DE-15. 

4.4.2.11.3.1  Data. 

Due  to  the  volume  of  the  cross-referenced  test  data,  it  has  not 
been  included  in  this  paragraph.  The  data  has  been  included  in 
the  appendix  C  paragraph  associated  with  test  DE-15. 

4.4.2.11.3.2  Significant  Problems. 

None 

4.4.2.11.3.3  PTRs  Generated. 

None 

4.4.2.12  Test  DE-16. 

The  objective  of  ADAS/ALDARS  Regression  Test  DE-16  was  to  verify 
ADAS  functionality  was  not  adversely  impacted  by  the  ALDARS 
contract  modifications  to  the  previously  baselined  version  of  the 
ADAS  software.  This  functionality  test  verifies  that  ADAS  would 
operate  with  I/O  errors. 


70 


4.4.2.12.1  Description . 

Verification  was  achieved  by  having  one  AWOS/ASOS  simulator,  and 
all  non-AWOS/ASOS/non-NLDN  simulators,  disable  communications  for 
1  minute.  Approximately  2-3  minutes  after  all  communications  had 
been  disabled  and  re-enabled,  the  test  operator  requested  a 
report  for  event  types  1,  2,  5,  7,  10,  12,  and  61.  The  ADAS  . 
Event  Log  Report  was  analyzed  to  determine  if  each  disconnection 
and  subsequent  reconnection  were  detected  and  recorded. 

4.4.2.12.2  Data  Reduction  and  Analysis  Method. 

Test  DE-16's  relevant  OT&E  formal  test  run  data  has  been 
incorporated  into  its  TCF  and  marked  with  the  evaluation  criteria 
cross  reference  numbers.  The  evaluation  criteria,  modified  to 
past-tense,  and  the  cross-referenced  test  data  from  DE-16' s  TCF 
are  included  below  in  this  report.  See  appendix  C  paragraph  for 
test  DE-16  for  the  completed  TCF  procedure  steps. 

For  this  test,  two  out  of  two  Evaluation  Criteria  passed.  The 
Evaluation  Criteria  used  to  determine  that  this  test's 
requirements  were  verified  are  contained  in  appendix  C. 

4.4.2.12.3  Results  and  Discussion. 

The  following  paragraphs:  contain  cross-reference  formal  test . 
data;  provide  details  of  significant  problems  encountered  during 
test  execution;  and  list  the  status  of  OT&E  PTRs  generated  with 
respect  to  test  DE-16. 

4.4.2.12.3.1  Data. 

Due  to  the  volume  of  the  cross-referenced  test  data,  it  has  not 
been  included  in  this  paragraph.  The  data  has  been  included  in 
the  appendix  C,  'DE-16'  section. 

4.4.2.12.3.2  Significant  Problems. 

None 

4.4.2.12.3.3  PTRs  Generated. 

None 

4.4.2.13  Test  DE-17  -  Recoverable  Software  Errors. 

RETIRED:  Actions  in  this  test  procedure  artificially  alter  the 

operation  of  the  ADAS  program  in  a  way  that  cannot  occur  in  the 
real  world.  While  the  testing  technique  used  worked  with  the 
original  ADAS,  for  which  this  test  was  originally  developed,  the 
technique  does  not  work  with  the  Mods  or  ALDARS  version  of  the 
ADAS.  As  the  conditions  employed  by  this  testing  technique 
cannot  occur  in  an  operational  environment,  this  test  procedure 
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has  been  deleted  from  the  ADAS  Regression  Test  Procedures  and  the 
ADAS/ALDARS  OT&E  Test  Procedures.  ADAS/ALDARS  OT&E  PTR  OTE-005, 
which  was  generated  during  this  test  has  been  closed. 

4.4.2.13.1  Description. 

This  procedure  stopped  the  communications  application  interface 
process  "cdl_io  -d"  using  the  Unix  'kill  -9'  command.  Recovering 
from  the  error  induced  by  this  action  is  beyond  the  scope  of  the 
ADAS/ALDARS  application  program. 

4.4.2.13.2  Data  Reduction  and  Analysis  Method. 

Not  Applicable  -  this  test  has  been  retired. 

4.4.2.13.3  Results  and  Discussion. 

4.4.2.13.3.1  Data. 

Not  Applicable 

4.4.2.13.3.2  Significant  Problems. 

Not  Applicable 

4.4.2.13.3.3  . PTRs  Generated . 

See  appendix  B  for  complete  details  of  all  PTRs  generated  during 
OT&E  testing.  The  PTRs  generated  with  respect  to  OT&E  formal 
test  runs  of  the  elevated  DT&E  tests  were: 

Moderate:  OTE-005  -  CLOSED 

4.4.2.14  Test  DE-18. 

The  objective  of  ADAS/ALDARS  Regression  Test  DE-18  was  to  verify 
ADAS  functionality  was  not  adversely  impacted  by  the  ALDARS 
contract  modifications  to  the  previously  baselined  version  of  the 
ADAS  software. 

This  functionality  test  verifies  that  ADAS  will  a  establish  a 
communications  link  with  the  NLDN  when  it  becomes  active,  even 
though  it  was  not  active  when  the  ADAS  application  initialized  at 
startup. 

4.4.2.14.1  Description. 

The  IPS  test  was  started  with  the  NLDN  simulator  cable 
disconnected.  The  ADAS  system  started  and  during  the 
initialization  phase  detected  NLDN  was  not  available.  ADAS 
continued  to  the  Operational  State,  running  in  Reduced  Mode.  The 
MPS  requested  the  RMS  Master  System  Mode  Data  Point.  The  IPS 
system  prompted  the  test  operator  to  reconnect  the  NLDN  to  ADAS, 
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and  acknowledge  the  prompt.  After  the  prompt  was  acknowledged, 
the  IPS  waited  60  seconds  repeating  the  MPS  request  for  the 
System  Mode  datapoint.  After  ADAS  responded  to  the  datapoint 
request,  the  test  operator  was  prompted  to  login,  request  an 
event  log  report  for  event  type  61,  logout,  and  acknowledge  the 
prompt.  When  this  prompt  was  acknowledged,  the  IPS  terminates 
the  test. 

4.4.2.14.2  Data  Reduction  and  Analysis  Method. 

Test  DE-18 's  relevant  OT&E  formal  test  run  data  has  been 
incorporated  into  its  TCF  and  marked  with  the  evaluation  criteria 
cross  reference  numbers.  The  evaluation  criteria,  modified  to 
past-tense,  and  the  cross-referenced  test  data  from  DE-18 's  TCF 
are  included  below  in  this  report.  See  appendix  C  paragraph  for 
test  DE-18  for  the  completed  TCF  procedure  steps. 

For  this  test,  four  out  of  four  Evaluation  Criteria  passed.  The 
Evaluation  Criteria  used  to  determine  that  this  test's 
requirements  were  verified  are  contained  in  appendix  C. 

4.4.2.14.3  Results  and  Discussion. 

The  following  paragraphs:  contain  cross-ref erence  formal  test, 
data;  provide  details  of  significant  problems  encountered  during 
test  execution;  and  list  the  status  of  OT&E  PTRs  generated  with 
respect  to  test  DE-18. 

4.4.2.14.3.1  Data. 

Due  to  the  volume  of  the  cross-referenced  test  data,  it  has  not 
been  included  in  this  paragraph.  The  data  has  been  included  in. 
the  appendix  C,  'DE-18'  section. 

4.4.2.14.3.2  Significant  Problems. 

None 

4.4.2.14.3.3  PTRs  Generated. 

None 

4.4.3  Category  DTE. 

The  following  subparagraphs  summarize  the  OT&E  Category  DTE 
formal  test  runs. 

4. 4. 3.1  OT&E  Formal  Test  Runs. 

Verification  of  28  of  the  ADAS/ALDARS  OT&E  TVRTM  Metar 
requirements,  MSS2-001  through  MSS2-011  and  MSS2-013  through 
MSS2-029,  listed  in  appendix  A,  table  10.2-3,  were  addressed  by 
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OT&E  formal  test  runs  of  Development  Test  and  Evaluation  (DT&E) 
tests. 

4. 4. 3. 1.1  Description. 

Detailed  test  descriptions  and  procedures  have  been  provided  in 
the  ALDARS  contractor's  Software  Test  Plan  and  Software  Test 
Procedures . 

4. 4. 3. 1.2  Data  Reduction  and  Analysis  Method. 

Evaluation  was  performed  as  detailed  in  the  contractor's  Software 
Test  Procedures.  To  facilitate  the  analysis,  ADAS  Program 
Support  Facility  (PSE)  data  reduction  utilities  preprocessed  the 
test  data.  Test  data  processing  simplified  analysis  by  splitting 
WMSCR,  DLP,  WARP,  and  ITWS  log  files  into  individual  files  based 
on  message  site  ID. 

4. 4. 3. 1.3  Results  and  Discussion. 

The  following  paragraphs  discuss  the  results  of  ADAS / ALDARS  OT&E 
formal  test  runs  of  the  DTE  tests. 

4. 4. 3. 1.3.1  Data . 

The  ADAS/ALDARS  OT&E  formal  test  run  data  were,  except  for  the 
date  and  timestamp,  identical  to  the  test  results  obtained  during 
the  DT&E  formal  test  runs.  Detailed  test  data  and  analysis 
results  have  already  been  provided  by  the  ADAS/ALDARS  contractor 
in  the  final  ADAS/ALDARS  DT&E  Test  Report. 

4. 4. 3. 1.3. 2  Significant  Problems. 

The  ADAS  SI  failed  to  clear  the  AWOS  Common  Weather  Parameters 
Pressure  Rise/Fall  Threshold  field  when  the  spacebar  was  pressed. 
(Refer  to  PTR  OTE-046.)  PTR  OTE-046  was  not  corrected  in  build 
4.19.  DME  has  indicated,  in  the  Version  Description  Document 
(VDD) ,  for  ADAS  Build  4.19,  that  this  error  will  be  corrected  in 
the  ADAS/Y2K  software  build. 

During  the  first  run  of  Test  180,  IPS  test  D25-01,  the  two 
problems  occurred  resulting  in  the  generation  of  PTRs  OTE-017  and 
OTE-018.  These  problems  have  not  been  reproduced  and  occurred 
only  once  after  running  unattended  over-'a  weekend.  The  problems 
did  not  occur  during  the  second  execution  of  the  test,  and  PTRs 
OTE-017  and  OTE-018  have  been  closed. 
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4. 4. 3. 1.3. 3  PTRs  Generated. 

See  appendix  B  for  complete  details  of  all  PTRs  generated  during 
OT&E  testing.  The  PTRs  generated  with  respect  to  OT&E  formal 
test  runs  of  the  elevated  DT&E  tests  were: 

Major:  OTE-017  -  CLOSED 

OTE-018  -  CLOSED 
Moderate:  OTE-046  -  OPEN 

4. 4. 3. 2  Conclusions. 

The  ADAS/ALDARS  software  is  in  accordance  with  ADAS/ALDARS  OT&E 
TVRTM  requirements  MSS2-001  through  MSS2-011  and  MSS2-013  through 
MSS2-029,  listed  in  table  10.2-3  in  appendix  A  of  this  report. 

4. 4. 3. 3  Recommendations. 

The  ADAS / Y 2 K  Contract  Statement  Of  Work  (SOW)  must  include 
ADAS/ALDARS  PTR  OTE-046  as  a  ADAS/Y2K  contract  requirement.  (See 
ADAS/ALDARS  OT&E  Test  Category  PT . ) 

4.4.4  Category  IN  -  Integration  Tests. 

4. 4. 4. 4  Test  IN-01. 

The  objective  of  ADAS/ALDARS  Regression  Test  IN-01  was  to  verify 
ADAS  functionality  was  not  adversely  impacted  by. the  ALDARS 
contract  modifications  to  the  previously  baselined  version  of  the 
ADAS  software. 

4. 4. 4. 4.1  Description . 

The  IPS  test  was  started  with  all  configured  simulators  enabled. 
After  running  for  two  mission  cycles,  the  MPS  simulator  was _ 
disabled  for  approximately  30  seconds  (three  retries  presuming  a 
retry  is  10  seconds) .  The  MPS  simulator  was  then  re-enabled  and 
run  for  two  additional  mission  cycles.  The  operator  was  then 
prompted  to  login,  request  a  report  for  event  type  7,  logout,  and 
acknowledge  the  prompt.  When  the  prompt  was  acknowledged,  the 
IPS  terminated  the  test. 

4. 4. 4. 4. 2  Data  Reduction  and  Analysis  Method. 

Test  IN-01' s  relevant  OT&E  formal  test  run  data  has  been 
incorporated  into  its  TCF  and  marked  with  the  evaluation  criteria 
cross  reference  numbers.  The  evaluation  criteria,  modified  to 
past-tense,  and  the  cross-referenced  test  data  from  IN-01 's  TCF 
are  included  below  in  this  report.  See  appendix  C  paragraph  for 
test  IN-01  for  the  completed  TCF  procedure  steps. 
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For  this  test,  two  out  of  two  Evaluation  Criteria  passed.  The 
Evaluation  Criteria  used  to  determine  that  this  test's 
requirements  were  verified  are  contained  in  appendix  C. 

4. 4. 4. 4. 3  Results  and  Discussion . 

The  following  paragraphs:  contain  cross-reference  formal  test 
data;  provide  details  of  significant  problems  encountered  during 
test  execution;  and  list  the  status  of  OT&E  PTRs  generated  with 
respect  to  test  IN-01. 

4 . 4 . 4 . 4 . 3 . 1  Data . 

Due  to  the  volume  of  the  cross-referenced  test  data,  it  has  not 
been  included  in  this  paragraph.  The  data  has  been  included  in 
the  appendix  C,  'IN-01'  section. 

4. 4. 4. 4. 3. 2  Significant  Problems. 

None 

4. 4. 4. 4. 3. 3  PTRs  Generated . 

None 

4. 4. 4. 5  Test  IN-02. 

The  objective  of  ADAS/ALDARS  Regression  Test  IN-02  was  to  verify 
ADAS  functionality  was  not  adversely  impacted  by  the  ALDARS 
contract  modifications  to  the  previously  baselined  version  of  the 
ADAS  software. 

4. 4. 4. 5.1  Description. 

The  IPS  test  was  started  with  all  configured  simulators  enabled. 
After  running  for  two  mission  cycles,  the  first  AWOS  simulator 
(site  K001)  was  disabled  for  approximately  30  seconds  (three 
retries  presuming  a  retry  is  10  seconds).  The  simulator  was  then 
re-enabled  and  run  for  two  additional  mission  cycles.  The 
operator  was  then  prompted  to  login,  request  a  report  for  event 
type  5,  logout,  and  acknowledge  the  prompt.  When  the  prompt  was 
acknowledged,  the  IPS  terminated  the  test. 

4. 4. 4. 5. 2  Data  Reduction  and  Analysis  Method . 

Test  IN-02' s  relevant  OT&E  formal  test  run  data  has  been 
incorporated  into  its  TCF  and  marked  with  the  evaluation  criteria 
cross  reference  numbers.  The  evaluation  criteria,  modified  to 
past-tense,  and  the  cross-referenced  test  data  from  IN-02 's  TCF 
are  included  below  in  this  report.  See  appendix  C  paragraph  for 
test  IN-02  for  the  completed  TCF  procedure  steps. 
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For  this  test,  two  out  of  two  Evaluation  Criteria  passed.  The 
Evaluation  Criteria  used  to  determine  that  this  test's 
requirements  were  verified  are  contained  in  appendix  C. 

4. 4. 4. 5. 3  Results  and  Discussion. 

The  following  paragraphs:  contain  cross-reference  formal  test ^ 
data;  provide  details  of  significant  problems  encountered  during 
test  execution;  and  list  the  status  of  OT&E  PTRs  generated  with 
respect  to  test  IN-02. 

.4. 4. 4. 5. 3.1  Data . 

Due  to  the  volume  of  the  cross-referenced  test  data,  it  has  not 
been  included  in  this  paragraph.  The  data  has  been  included  in 
the  appendix  C,  ’IN-02'  section. 

4. 4. 4. 5. 3. 2  Significant  Problems. 

None 

4. 4. 4. 5. 3. 3  PTRs  Generated. 

None 

4.4.4. 6  Test  IN-03. 

The  objective  of  ADAS/ALDARS  Regression  Test  IN-03  was  to  verify 
ADAS  functionality  was  not  adversely  impacted  by  the  ALDARS 
contract  modifications  to  the  previously  baselined  version  of  the 
ADAS  software. 

4. 4. 4. 6.1  Description. 

The  IPS  test  was  started  with  all  configured  simulators  enabled. 
After  running  for  two  mission  cycles,  the  DLP  simulator  was . 
disabled  for  approximately  30  seconds  (three  retries  presuming  a 
retry  is  10  seconds) .  The  DLP  simulator  was  then  re— enabled  and 
run  for  two  additional  mission  cycles.  The  operator  was  then 
prompted  to  login,  request  a  report  for  event  type  1,  logout,  and 
acknowledge  the  prompt.  When  the  prompt  was  acknowledged,  the 
IPS  terminated  the  test. 

4. 4. 4. 6. 2  Data  Reduction  and  Analysis  Method. 

Test  IN-03 1 s  relevant  OT&E  formal  test  run  data  has  been 
incorporated  into  its  TCF  and  marked  with  the  evaluation  criteria 
cross  reference  numbers.  The  evaluation  criteria,  modified  to 
past-tense,  and  the  cross-referenced  test  data  from  IN-03' s  TCF 
are  included  below  in  this  report.  See  appendix  C  paragraph  for 
test  IN-03  for  the  completed  TCF  procedure  steps. 
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For  this  test,  two  out  of  two  Evaluation  Criteria  passed.  The 
Evaluation  Criteria  used  to  determine  that  this  test's 
requirements  were  verified  are  contained  in  appendix  C. 

4. 4. 4. 6. 3  Results  and  Discussion. 

The  following  paragraphs:  contain  cross-reference  formal  test 
data;  provide  details  of  significant  problems  encountered  during 
test  execution;  and  list  the  status  of  OT&E  PTRs  generated  with 
respect  to  test  IN-03. 

4 . 4 . 4 . 6 . 3 . 1  Data . 

Due  to  the  volume  of  the  cross-referenced  test  data,  it  has  not 
been  included  in  this  paragraph.  The  data  has  been  included  in 
appendix  C,  'IN-03'  section. 

4. 4. 4. 6. 3. 2  Significant  Problems. 

None 

4. 4. 4. 6. 3. 3  PTRs  Generated . 

None 

4. 4. 4. 7  Test  IN-04 . 

The  objective  of  ADAS/ALDARS  Regression  Test  IN-04  was  to  verify 
ADAS  functionality  was  not  adversely  impacted  by  the  ALDARS 
contract  modifications  to  the  previously  baselined  version  of  the 
ADAS  software. 

4. 4. 4. 7.1  Description. 

The  IPS  test  was  started  with  all  configured  simulators  enabled. 
After  running  for  two  mission  cycles,  the  WARP  simulator  was 
disabled  for  approximately  30  seconds  (three  retries  presuming  a 
retry  is  10  seconds) .  The  WARP  simulator  was  then  re-enabled  and 
run  for  two  additional  mission  cycles.  The  operator  was  then 
prompted  to  login,  request  a  report  for  event  type  2,  logout,  and 
acknowledge  the  prompt.  When  the  prompt  was  acknowledged,  the 
IPS  terminated  the  test. 

4. 4. 4. 7. 2  Data  Reduction  and  Analysis  Method. 

Test  IN-04 's  relevant  OT&E  formal  test  run  data  has  been 
incorporated  into  its  TCF  and  marked  with  the  evaluation  criteria 
cross  reference  numbers.  The  evaluation  criteria,  modified  to 
past-tense,  and  the  cross-referenced  test  data  from  IN-04 's  TCF 
are  included  below  in  this  report.  See  appendix  C  paragraph  for 
test  IN-04  for  the  completed  TCF  procedure  steps. 
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For  this  test,  two  out  of  two  Evaluation  Criteria  passed.  The 
Evaluation  Criteria  used  to  determine  that  this  test's 
requirements  were  verified  are  contained  in  appendix  C. 

4. 4. 4. 7. 3  Results  and  Discussion. 

The  following  paragraphs:  contain  cross-reference  formal  test, 
data;  provide  details  of  significant  problems  encountered  during 
test  execution;  and  list  the  status  of  OT&E  PTRs  generated  with 
respect  to  test  IN-04. 

4 . 4 . 4 . 7 . 3 . 1  Data . 

Due  to  the  volume  of  the  cross-referenced  test  data,. it  has  not 
been  included  in  this  paragraph.  The  data  has  been  included  in 
the  appendix  C,  ’ IN-04 1  section. 

4. 4. 4. 7. 3. 2  Significant  Problems. 

None 

4. 4. 4. 7. 3. 3  PTRs  Generated. 

None 

4. 4. 4. 8  Test  IN-05. 

The  objective  of  ADAS/ALDARS  Regression  Test  IN-05  was  to  verify 
ADAS  functionality  was  not  adversely  impacted  by  the  ALDARS 
contract  modifications  to  the  previously  baselined  version  of  the 
ADAS  software. 

4. 4. 4. 8.1  Description. 

The  IPS  test  was  started  with  all  configured  simulators  enabled. 
After  running  for  two  mission  cycles,  the  WMSCR  simulator  was 
disabled  for  approximately  30  seconds  (three  retries  presuming  a 
retry  is  10  seconds) .  The  WMSCR  simulator  was  then  re-enabled 
and  run  for  two  additional  mission  cycles.  The  operator  was  then 
prompted  to  login,  request  a  report  for  event  type  12,  logout, 
and  acknowledge  the  prompt.  When  the  prompt  was  acknowledged, 
the  IPS  terminated  the  test. 

4. 4. 4. 8. 2  Data  Reduction  and  Analysis  Method. 

Test  IN-05 ’s  relevant  OT&E  formal  test  run  data  has  been 
incorporated  into  its  TCF  and  marked  with  the  evaluation  criteria 
cross  reference  numbers.  The  evaluation  criteria,  modified  to 
past-tense,  and  the  cross-referenced  test  data  from  IN-05’ s  TCF 
are  included  below  in  this  report.  See  appendix  C  paragraph  for 
test  IN-05  for  the  completed  TCF  procedure  steps. 


79 


For  this  test,  two  out  of  two  Evaluation  Criteria  passed.  The 
Evaluation  Criteria  used  to  determine  that  this  test's 
requirements  were  verified  are  contained  in  appendix  C. 

4. 4. 4. 8. 3  Results  and  Discussion. 

The  following  paragraphs:  contain  cross-reference  formal  test 
data;  provide  details  of  significant  problems  encountered  during 
test  execution;  and  list  the  status  of  OT&E  PTRs  generated  with 
respect  to  test  IN-05. 

4 . 4 . 4 . 8 . 3 . 1  Data . 

Due  to  the  volume  of  the  cross-referenced  test  data,  it  has  not 
been  included  in  this  paragraph.  The  data  has  been  included  in 
appendix  C,  1  IN-05 1  section. 

4. 4. 4. 8. 3. 2  Significant  Problems. 

None 

4. 4. 4. 8. 3. 3  PTRs  Generated. 

None 

4. 4. 4. 9  Test  IN-12D  -  NADIN  Users  ( ITWS, DLP, WARP, WMSCR) . 

The  objective  of  this  test  was  to  verify  particular  ALDARS  NAS- 
SS-1000  requirements  (see  appendix  A) .  In  order  to  meet  this 
objective,  this  test  was  used  to  verify  that  the  ADAS 
communicated  with  the  ITWSs,  DLP,  WARP,  and  WMSCR  IAW: 

a.  The  service  Class  4  of  the  Transport  Layer  protocol 
defined  in  ISO  8073,  and 

b.  The  Transition  State  (pre-End  State)  X.25  protocols  for 
the  Network  Layer,  Data  link  Layer,  and  Physical  Layer  as  stated 
in  the  NADIN  ICD,  NAS-IC-25084302 . 

4. 4. 4.9.1  Description. 

The  ADAS  configuration  was  configured  to  correspond  to  the  IPS 
configuration.  Additionally,  the  ADAS  was  configured  to 
geographically  cover  the  continental  U.'S.  This  was  accomplished 
by  accessing  the  site  adaptation  data  using  the  ASC.  With  the 
ADAS  configured  in  this  way,  the  ITWS  simulators  received  all  LDD 
Flash  Messages.  This  allowed  for  easier  verification  that  ADAS 
properly  disseminated  all  LDD  Flash  Messages  to  ITWS. 

The  IPS  was  configured  to  correspond  to  the  ADAS  configuration 
including  the  simulation  of  5  circuits  with  2  AWOS  stations  and 
13  ASOS  stations.  One  circuit  had  10  stations  (drops) .  The 
other  four  circuits  had  five  stations.  The  reason  to  simulate  15 


80 


stations  was  to  simulate  an  ADAS  operational  environment.  This 
served  to  verify  that  the  ADAS  s  SW/HW  could  properly  service  an 
NLDN  together  with  many  (simulated)  AWOS/ASOS  stations. 
Additionally,  IPS  was  configured  to  simulate  6  ITWSs,  WARP,  DLP, 
WMSCR  and  the  Lightning  Simulator  Script  which  contained  a  valid 
LDD  Flash  Messages  with  maximum  length  (20  Flash  Records) . 

4. 4. 4. 9. 2  Data  Reduction  and  Analysis  Method. 

The  data  file  on  the  Data  Capture  PC  (PCI)  that  captured  IPS  data 
contained  the  following: 

AWOS  ERROR  file:  1IN-12DA.AWER 

ITWS(l)  LDD  file  :  i IN- 12 DA. I 1LD 
ITWS(l)  AWOS  file:  HN-12DA. HAW 
WARP ( 1 )  AWOS  file:  HN-12DA.RWPA 
DLP  (1)  AWOS  file:  HN-12DA.  DLPA 
WMSCR  SHEF  file:  HN-12DA. SHEF 

WMSCR  METAR  file:  i IN- 12 DA. META 
WMSCR  SUMMARY  f ile : HN-12DA. SUMM 
AWOS  MESSAGES  file:  OIN-12DA. AWOS 

NLDN  LDD  MESSAGES  file:  OIN-12DA. NLDN 
SHEF  MESSAGES  file:  OIN-12DA. SHEF 

METAR  MESSAGES  file:  o I N- 1 2 DA . ME TA 

SUMMARY  MESSAGES  file:  OIN-12DA. SUMM 

The  data  file  on  the  Data  Capture  PC  (PC2 )  that  captured  ADAS 
data  contained  the  following: 

a.  The  NLDN  Communications  Datapoint. 

The  DLP  Communications  Datapoint. 

The  WARP  Communications  Datapoint. 

The  ITWS1  Communications  Datapoint. 

The  WMSCR  Communications  Datapoint. 

b.  01  —  EVENT  Log  for  status  of  the  DLP  connection  had 

changed.  . 

02  —  EVENT  Log  for  status  of  the  WARP  connection  had 

changed. 

05  —  EVENT  Log  for  status  of  the  AWOS/ASOS  connection 
had  changed. 

12  —  EVENT  Log  for  status  of  the  WMSCR  connection  had 

changed. 

61  —  EVENT  Log  for  status  of  the  ITWS  connection  had 

changed. 

62  —  EVENT  Log  for  status  of  the  NLDN  connection  had 

changed. 

The  test  data  in  the  NLDN  LDD  OUTPUT  MESSAGE  file  and  the  ITWS1 
LDD  ( IML)  file  were  examined  to  verify  that  the  LDD  bound  for 
ITWS  moved  through  the  ADAS  within  5  seconds. 
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The  test  data  in  the  ADAS  AWOS  OUTPUT  MESSAGE  file  and  the  ITWS1 
AWOS  (IML)  file  were  examined  to  verify  that  the  OMO  bound  for 
ITWS  moved  through  ADAS  within  10  seconds.  (K001) 

The  test  data  in  the  ADAS  AWOS  OUTPUT  MESSAGE  file  and  the  DLP 
AWOS  (IML)  file  Were  examined  to  verify  that  the  OMO  bound  for 
ITWS  moved  through  ADAS  within  10  seconds.  (K001) 

The  test  data  in  the  ADAS  AWOS  OUTPUT  MESSAGE  file  and  the 
RWP(WARP)  AWOS  (IML)  file  were  examined  to  verify  that  the  OMO 
bound  for  ITWS  moved  through  ADAS  within  10  seconds.  (K001) 

The  test  data  in  the  ADAS  AWOS  OUTPUT  MESSAGE  file  and  the  WMSCR 
METAR  INPUT  MESSAGE  file  were  examined  to  verify  that  the  METAR 
reports  moved  through  the  ADAS  within  10  seconds.  (K001  -  AWOS 
METAR) 

The  test  data  in  the  ADAS  METAR  OUTPUT  MESSAGE  file  and  the  WMSCR 
METAR  INPUT  MESSAGE  file  were  examined  to  verify  that  ADAS 
disseminated  ASOS  SPECI  messages  within  5  seconds.  (K006  -  ASOS 
SPECI) 

The  test  data  in  the  ADAS  METAR  OUTPUT  MESSAGE  file  and  the  WMSCR 
METAR  INPUT  MESSAGE  file  were  examined  to  verify  that  ADAS 
disseminated  ASOS  METAR  messages  within  10  seconds.  (K005  -  ASOS 
METAR) 

The  test  data  in  the  ADAS  AWOS  OUTPUT  MESSAGE  file  and  the  WMSCR 
METAR  INPUT  MESSAGE  file  were  examined  to  verify  that  the  SPECI 
reports  moved  through  the  ADAS  within  5  seconds.  (K002  -  AWOS 
SPECI) 

The  test  data  in  the  ADAS  SUMMARY  OUTPUT  MESSAGE  file  and  the 
WMSCR  SUMMARY  INPUT  MESSAGE  file  were  examined  to  verify  that  the 
Daily/Monthly  reports  processed  in  the  same  minute  as 
received. (K007  -  AWOS  SUMMARY,  primary), (K008  -  AWOS  SUMMARY, 
intermediate) , and  (K009  -  AWOS  SUMMARY,  monthly)  ' 

The  test  data  in  the  ADAS  SHEF  OUTPUT  MESSAGE  file  and  the  WMSCR 
SHEF  INPUT  MESSAGE  file  were  examined  to  verify  that  the  SHEF 
reports  processed  in  the  same  minute  as  received.  (K010  -  AWOS 
SHEF,  hourly), (K011  -  AWOS  SHEF,  15  minute) 

The  test  data  in  the  WMSCR  METAR  INPUT  MESSAGE  file  was  used  to 
verify  that  the  Metar  Format  message  outputted  priority  of  SPECI 
messages  (K002,k006),  and  METAR  messages  (k001,k005). 

Reviewed  the  ADAS  Event  Log  for  events  pertinent  to  this  test, 
particularly  Event  Types: 

01  --  EVENT  Log  for  status  of  the  DLP  connection  had 
changed. 
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EVENT  Log  for  status  of  the  WARP  connection  had 

EVENT  Log  for  status  of  the  AWOS/ASOS  connection  had 

EVENT  Log  for  status  of  the  WMSCR  connection  had 

EVENT  Log  for  status  of  the  ITWS  connection  had 

EVENT  Log  for  status  of  the  NLDN  connection  had 

Reviewed  the  Communications  Datapoint  obtained  from  the  ADAS  SI 
to  verify  that  the  NADIN  Users (ITWS,  NLDN,  WARP,  DLP,  WMSCR) 
properly  Interfaced  with  ADAS. 

For  this  test,  four  out  of  seven  Evaluation  Criteria  fully  passed 
and  three  out  of  seven  Evaluation  Criteria  partially, passed.  The 
Evaluation  Criteria  used  to  determine  that  this  test's 
requirements  were  verified  are  contained  in  appendix  C. 

4. 4. 4. 9. 3  Results  and  Discussion. 

The  following  paragraphs:  contain  cross-reference  formal  test _ 
data;  provide  details  of  significant  problems  encountered  during 
test  execution;  and  list  the  status  of  OT&E  PTRs  generated  with 
respect  to  test  IN-12D. 

4 . 4 . 4 . 9 . 3 ♦ 1  Data . 

Due  to  the  volume  of  the  cross-referenced  test  data,  _ it  has  not 
been  included  in  this  paragraph.  The  data  has  been  included  in 
the  appendix  C  paragraph  associated  with  test  IN-12D. 

4. 4. 4. 9. 3. 2  Significant  Problems. 

None 

4. 4. 4. 9. 3. 3  PTRs  Generated. 

None 

4.4.4.10  Test  IN-12E  -  WMSCR  Interface. 

The  objective  of  this  test  was  to  verify  particular  ALDARS  NAS- 
SS-1000  requirements  (see  appendix  A) .  In  order  to  meet  this 
objective,  this  test  used  to  verify  that  the  ADAS  properly 
interfaced  mechanically,  electrically,  and  functionally  with ^ the 
NLDN  Interface  "live",  AWOS  Interface,  and  WMSCR  Interface  via 
the  NADIN  II  packet  switching  network  (PSN) . 


02  — 
changed . 

05  -- 
changed. 

12  — 
changed. 

61  — 
changed. 

62  — 
changed. 


83 


4.4.4.10.1  Description. 

The  ADAS  was  configured  to  correspond  to  the  IPS  with  a  "live" 
WMSCR  interface,  "live"  NLDN  interface,  and  two  "live"  AWOS 
interfaces  configurations.  The  adaptation  database  parameters 
for  communication  characteristics  of  the  "live"  circuit  (s)  to  be 
tested  were  placed  "IN-SERVICE." 

The  IPS  was  configured  to  correspond  to  the  ADAS  configuration 
including  the  simulation  of  5  circuits  with  15  AWOS  stations. 

One  circuit  had  10  "simulated"  stations  (drops).  The  other  four 
circuits  had  three  "simulated"  stations  and  two  "live"  AWOSs. 

The  reason  to  simulate  15  stations  was  to  simulate  an  ADAS 
operational  environment.  This  served  to  verify  that  the  ADAS 
SW/HW  could  properly  service,  a  WMSCR  Interface,  NLDN  Interface 
together  with  many  ( "live'V'simulated" )  AWOS  stations. 
Additionally,  IPS  was  configured  to  simulate  CTS. 

4.4.4.10.2  Data  Reduction  and  Analysis  Method. 

Reviewed  the  ADAS  Event  Log  for  events  pertinent  to  this  test, 
particularly  Event  Types: 

05  —  EVENT  Log  for  status  of  the  AWOS/ASOS  connection  has 
changed. 

12  --  EVENT  Log  for  status  of  the  WMSCR  connection  has 
changed. 

62  --  EVENT  Log  for  status  of  the  NLDN  connection  has 
changed.  . 


Reviewed  the  Communications  Datapoint  obtained  from  the  ADAS  SI 
to  verify  that  NLDN  interfaced  with  ADAS. 

Correlated/evaluated  the  data  obtained  from  WMSCR  with  related 
ADAS  data : 

The  test  data  in  the  ADAS  AWOS  OUTPUT  MESSAGE  file  and  the  WMSCR 
METAR  INPUT  MESSAGE  file  were  examined  to  verify  that  the  METAR 
reports  moved  through  the  ADAS  within  10  seconds . (K001  -  AWOS 
METAR) 

The  test  data  in  the  ADAS  METAR  OUTPUT  MESSAGE  file  and  the  WMSCR 
METAR  INPUT  MESSAGE  file  were  examined  to  verify  that  ADAS 
disseminated  ASOS  SPECI  messages  within  5  seconds. (K006  -  ASOS 
SPECI) 

The  test  data  in  the  ADAS  METAR  OUTPUT  MESSAGE  file  and  the  WMSCR 
METAR  INPUT  MESSAGE  file  were  examined  to  verify  that  ADAS 
disseminated  ASOS  METAR  messages  within  10  seconds.  (K005  -  ASOS 
METAR) 
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The  test  data  in  the  ADAS  SUMMARY  OUTPUT  MESSAGE  file  and  the 
WMSCR  SUMMARY  INPUT  MESSAGE  file  were  examined  to  verify  that  the 
Daily/Monthly  reports  processed  in  the  same  minute  as 
received. (K009  -  AWOS  SUMMARY,  primary) , (K010  -  AWOS  SUMMARY, 
intermediate) , and  (K011  -  AWOS  SUMMARY,  monthly) 

The  test  data  in  the  ADAS  SHEF  OUTPUT  MESSAGE  file  and  the  WMSCR 
SHEF  INPUT  MESSAGE  file  were  examined  to  verify  that  the  SHEF 
reports  processed  in  the  same  minute  as  received.  (K007  -  AWOS 
SHEF,  hourly) , (K008  -AWOS  SHEF,  15  minute) 

For  this  test,  three  out  of  three  Evaluation  Criteria  passed. 

The  Evaluation  Criteria  used  to  determine  that  this  test's 
requirements  were  verified  are  contained  in  appendix  C. 

4.4.4.10.3  Results  and  Discussion. 

The  following  paragraphs:  contain  cross-reference  formal  test 
data;  provide  details  of  significant  problems  encountered  during 
test  execution;  and  list  the  status  of  OT&E  PTRs  generated  with 
respect  to  test  IN-12E. 

4.4.4.10.3.1  Data. 

Due  to  the  volume  of  the  cross-ref erenced  test  data,  it  has  not 
been  included  in  this  paragraph.  The  data  has  been  included  in 
the  appendix  C  paragraph  associated  with  test  IN-12E. 

4.4.4.10.3.2  Significant  Problems. 

There  were  three  significant  problems  during  OT&E  Formal  Test 
Runs  of  IN-12E,  resulting  in  the  generation  of  PTRs  OTE-003, 
OTE-048,  and  OTE-053.  PTR  OTE-003  was  closed  after  testing  of 
the  AOS-540  ADAS/ALDARS  Deployment  Build  verified  ADAS 
reformatted  ASOS  Metar  messages  with  lines  longer  than  69 
characters.  PTR  OTE-053  was  closed  when  testing  of  the 
deployment  build  verified  ADAS  sends  SPECI  messages  to  WMSCR  m 
ADUs  with  a  WMO  type  of  "SP."  PTR  OTE-048  was  opened  when 
testing  revealed  that  ADAS  fails  to  complete  the  current  mission 
cycle  if  ADAS  receives  an  erroneous  AWOS  format  message.  ADAS 
apparently  sends  an  error  message  to  the  responsible  AWOS  site, 
then  fails  to  complete  the  mission  phase  because  it  is  waiting 
for  the  station  to  resend  a  correct  OMO  for  the  current  mission 
cycle. 

4.4.4.10.3.3  PTRs  Generated . 

See  appendix  B  for  complete  PTR  details.  The  PTRs  generated  with 
respect  to  this  test  are: 

Major  PTR:  OTE-003  -  CLOSED. 

Major  PTR:  OTE-048  -  OPEN. 

Major  PTR:  OTE-053  -  CLOSED. 
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4.4.5  Category  IT  -  ITWS  Tests. 

4. 4. 5.1  Test  IT-01. 

The  objective  of  ADAS/ALDARS  OT&E  Test  IT-01  was  to  verify  ADAS 
functionality  added  by  the  ALDARS  contract  modifications  were 
similar  to  associated  DLP/WARP  functionality  in  the  previously 
baselined  version  of  the  ADAS  software  (refer  to  tests  IN-03  and 
IN-04) .  Test  IT-01  also  provided  supporting  data  for  the 
verification  of  ADAS/ALDARS  requirement  ISS2-001  listed  in 
table  10.2-5,  appendix  A.  This  functionality  test  verified  ADAS: 
established  communication  with,  sent  surface  observations  and 
lightning  data  to,  detected  .ITWS  communications  failures,  and 
resumed  message  transfer  when  communications  were  re-established 
with;  all  configured  ITWSs. 

4. 4. 5. 1.1  Description. 

The  IPS  test  began  with  all  configured  simulators  enabled. 

Twenty  seconds  into  the  third  mission  cycle,  the  six  ITWS 
simulators  were  disabled  for  approximately  30  seconds  (three 
retries  presuming  a  retry  is  10  seconds),  then  re-enabled.  Two 
mission  cycles  later,  the  MPS  simulator  prompted  the  operator 
wait  for  ITWS  communications  to  resume  (as  indicated  by  the  IUC) , 
login,  report  ADAS  event  type  61,  logout,  and  acknowledge  the 
prompt.  When  the  prompt  was  acknowledged,  the  IPS  terminated  the 
test. 

4. 4. 5. 1.2  Data  Reduction  and  Analysis  Method. 

Test  IT-01 's  relevant  OT&E  formal  test  run  data  has  been 
incorporated  into  its  TCF  and  marked  with  the  evaluation  criteria 
cross  reference  numbers.  The  evaluation  criteria,  modified  to 
past-tense,  and  the  cross-referenced  test  data  from  IT-01' s  TCF 
are  included  below  in  this  report.  See  appendix  C  paragraph  for 
test  IT-01  for  the  completed  TCF  procedure  steps. 

For  this  test,  six  out  of  six  Evaluation  Criteria  passed.  The 
Evaluation  Criteria  used  to  determine  that  this  test's 
requirements  were  verified  are  contained  in  appendix  C. 

4. 4. 5. 1.3  Results  and  Discussion . 

The  following  paragraphs:  contain  cross-reference  formal  test 
data;  provide  details  of  significant  problems  encountered  during 
test  execution;  and  list  the  status  of  OT&E  PTRs  generated  with 
respect  to  test  IT-01. 
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4 . 4 . 5 . 1 . 3 . 1  Data .  . 

Due  to  the  volume  of  the  cross-referenced  test  data,  it  has  not 
been  included  in  this  paragraph.  The  data  has  been  included  in 
the  appendix  C,  'IT-01'  section. 

4. 4. 5. 1.3. 2  Significant  Problems. 

During  the  first  formal  test  run,  ADAS  resumed  transfer  of  LDD 
messages  to  the  ITWSs,  but  failed  to  resume  sending  AWOS  OMOs  to 
the  ITWSs  (refer  to  PTR  OTE-004) .  DME  updated  the  software  and 
demonstrated  during  DT&E  #2  that  ADAS  resumed  sending  AWOS  OMOs 
after  re-establishing  communications  with  the  ITWSs.  However, 
during  the  OT&E  #2  formal  test  run,  ADAS  again  failed  to  resume 
OMO  transfer.  With  AOS-530  assistance,  analysis  isolated  the . 
software  code  which  induced  the  error.  AOS-530  developed  a  fix, 
and  provided  ACT-320  with  an  updated  software  module.  ACT-320 
testing  of  the  ADAS  with  the  updated  module  verified  correction 
of  the  problem,  showing  ADAS  resumes  transfer  of  LDD  and  OMO 
messages  when  communication  with  the  ITWSs  is  re-established. 

The  AOS-530  fix  has  been  incorporated  into  the  software  build  to 
be  deployed  to  the  ADAS  field  sites. 

As  detailed  in  PTR  OTE-006,  the  maximum  value  of  the  'Setlog' 
utility  had  been  altered,  but  has  been  restored  to  its  previous 
value . 

4. 4. 5. 1.3. 3  PTRs  Generated 

See  appendix  B  for  complete  details  of  all  PTRs  generated  during 
OT&E  testing.  The  PTRs  generated  with  respect  to  OT&E  formal 
test  runs  of  test  IT-01  were: 

Critical:  OTE-004  -  CLOSED 
Minor:  OTE-006  -  CLOSED 

4, 4. 5, 2  Test  IT-02. 

The  objective  of  ADAS/ALDARS  Regression  Test  IT-02  was  to  verify 
ADAS  functionality  was  not  adversely  impacted  by  the  ALDARS 
contract  modifications  to  the  previously  baselined  version  of  the 
ADAS  software. , 

4. 4. 5. 2,1  Description. 

This  procedure  verified  that  DLP,  ITWS,  and  WARP  output 
processing  assembled  and  delivered  multiple  AWOS  messages  when 
more  than  one  message  was  ready  for  delivery  within  a  10-second 
interval.  This  was  accomplished  by  gradually  increasing  the 
number  of  AWOS  simulators  responding  to  the  ADAS  AWOS  poll  so 
that  the  message  traffic  increases  to  a  point  where  two  or  more 
messages  were  ready  for  delivery  in  the  10-second  interval. 
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4. 4. 5. 2. 2  Data  Reduction  and  Analysis  Method . 

Test  IT-02' s  relevant  OT&E  formal  test  run  data  has  been 
incorporated  into  its  TCF  and  marked  with  the  evaluation  criteria 
cross  reference  numbers.  The  evaluation  criteria,  modified  to 
past-tense,  and  the  cross-referenced  test  data  from  IT-02 ' s  TCF 
are  included  below  in  this  report.  See  appendix  C  paragraph  for 
test  IT-02  for  the  completed  TCF  procedure  steps. 

For  this  test,  four  out  of  four  Evaluation  Criteria  passed.'  The 
Evaluation  Criteria  used  to  determine  that  this  test's 
requirements  were  verified  are  contained  in  appendix  C. 

4. 4. 5. 2. 3  Results  and  Discussion. 

The  following  paragraphs:  contain  cross-reference  formal  test 
data;  provide  details  of  significant  problems  encountered  during 
test  execution;  and  list  the  status  of  OT&E  PTRs  generated  with 
respect  to  test  IT-02. 

4. 4. 5. 2. 3.1  Data. 

Due  to  the  volume  of  the  cross-referenced  test  data,  it  has  not 
been  included  in  this  paragraph.  The  data  has  been  included  in 
the  appendix  C,  'IT-02'  section. 

4. 4. 5. 2. 3. 2  Significant  Problems. 

None 

4. 4. 5. 2. 3. 3  PTRs  Generated. 

None 

4. 4. 5. 3  Test  IT-03 . 

The  objective  of  ADAS/ALDARS  Regression  Test  IT-03  was  to  verify 
ADAS  functionality  was  not  adversely  impacted  by  the  ALDARS 
contract  modifications  to  the  previously  baselined  version  of  the 
ADAS  software.  The  test  data  gathered  during  IT-03  formal  test 
runs  were  also  used  as  supporting  data  for  the  verification  of 
ADAS/ALDARS  TVRTM  requirements  ISS2-002,  ISS2-003,  ISS2-005,  and 
ISS2-006,  listed  in  appendix  A,  table  10.2-5. 

4, 4.5. 3.1  Description. 

This  procedure  verified  that  DLP,  ITWS,  and  WARP  output 
processing  assembled  and  delivered  multiple  variable  length  AWOS 
messages  when  more  than  one  message  was  ready  for  delivery  within 
a  10-second  interval.  This  was  accomplished  by  gradually 
increasing  the  number  of  AWOS  simulators  responding  to  the  poll 
so  that  the  message  traffic  increases  to  a  point  where  two  or 
more  variable  length  messages  were  ready  for  delivery  in  the 
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10-second  interval.  Messages  were  verified  to  determine  if  they 
were  delivered  unchanged  and  complete. 

4. 4. 5. 3. 2  Data  Reduction  and  Analysis  Method. 

Test  IT-03' s  relevant  OT&E  formal  test  run  data  has  been 
incorporated  into  its  TCF  and  marked  with  the  evaluation _ criteria 
cross-reference  numbers.  The  evaluation  criteria,  modified  to 
past-tense,  and  the  cross-referenced  test  data  from  IT-03 's  TCF 
are  included  below  in  this  report.  See  appendix  C  paragraph  for 
test  IT-03  for  the  completed  TCF  procedure  steps. 

For  this  test,  three  out  of  three  Evaluation  Criteria  passed. 

The  Evaluation  Criteria  used  to  determine  that  this  test's 
requirements  were  verified  are  contained  in  appendix  C. 

4. 4. 5. 3. 3  Results  and  Discussion. 

The  following  paragraphs:  contain  cross-reference  formal  test 
data;  provide  details  of  significant  problems  encountered  during 
test  execution;  and  list  the  status  of  OT&E  PTRs  generated  with 
respect  to  test  IT-03. 

4 . 4 . 5 . 3 . 3 . 1  Data . 

Due  to  the  volume  of  the  cross-referenced  test  data,  it  has  not 
been  included  in  this  paragraph.  The  data  has  been  included  in 
the  appendix  C,  'IT-03'  section. 

4. 4. 5. 3. 3. 2  Significant  Problems. 

None 

4. 4. 5. 3. 3. 3  PTRs  Generated.  . 

None 

4. 4. 5. 4  Test  IT-04. 


The  objective  of  ADAS/ALDARS  Regression  Test  IT-04  was  to  verify 
ADAS  functionality  was  not  adversely  impacted  by  the  ALDARS 
contract  modifications  to  the  previously  baselined  version  of  the 
ADAS  software. 

4. 4, 5, 4.1  Description .  . 

This  procedure  verified  the  correct  processing  of  error  response 
messages.  This  was  accomplished  by  increasing  the  AWOS  message 
traffic  to  overcome  the  buffering  threshold  and  having  the  DLP, 
the  WARP,  and  the  6  ITWS  simulators  responding  to  every  other 
group  of  20  messages  with  an  error  (despite  the  validity  of  the 
message) . 
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4. 4. 5. 4. 2  Data  Reduction  and  Analysis  Method. 

Test  IT-04 ' s  relevant  OT&E  formal  test  run  data  has  been 
incorporated  into  its  TCF  and  marked  with  the  evaluation  criteria 
cross-reference  numbers.  The  evaluation  criteria,  modified  to 
past-tense,  and  the  cross-referenced  test  data  from  IT-04' s  TCF 
are  included  below  in  this  report.  See  appendix  C  paragraph  for 
test  IT-04  for  the  completed  TCF  procedure  steps. 

For  this  test,  three  out  of  three  Evaluation  Criteria  passed. 

The  Evaluation  Criteria  used  to  determine  that  this  test's 
requirements  were  verified  are  contained  in  appendix  C. 

4. 4. 5. 4. 3  Results  and  Discussion. 

The  following  paragraphs:  contain  cross-reference  formal  test 
data;  provide  details  of  significant  problems  encountered  during 
test  execution;  and  list  the  status  of  OT&E  PTRs  generated  with 
respect  to  test  IT-04 . 

4 . 4 . 5 . 4 . 3 . 1  Data . 

Due  to  the  volume  of  the  cross-referenced  test  data,  it  has  not 
been  included  in  this  paragraph.  The  data  has  been  included  in  . 
the  appendix  C  paragraph  associated  with  test  IT-04. 

4. 4. 5. 4. 3. 2  Significant  Problems. 

The  IPS  sequence  files  for  the  WARP  and  six  ITWS  simulators, 
while  based  on  the  DLP  simulator  sequence  file,  were  not 
recognized  by  ADAS  as  error  message  ADUs . 

4. 4. 5. 4. 3. 3  PTRs  Generated. 

None 

4. 4. 5. 5  Test  IT-05  -  ITWS  Interface. 

The  objective  of  this  test  was  to  verify  particular  ALDARS  NAS- 
SS-1000  requirements  (see  appendix  A).  In  order  to  meet  this 
objective,  this  test  used  to  verify  that  ADAS  communicated  with 
the  ITWSs  in  accordance  with(IAW): 

a.  The  service  Class  4  of  the  Transport  Layer  protocol 
defined  in  ISO  8073,  and 

b.  The  Transition  State  (pre-End  State)  X.25  protocols  for 
the  Network  Layer,  Data  Link  Layer,  and  Physical  Layer  as  stated 
in  the  NADIN  ICD,  NAS-IC-25084302 . 
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4 .4. 5. 5.1  Description. 


The  ADAS  was  configured  to  correspond  to  the  IPS.  Additionally, 
the  ADAS  was  configured  to  geographically  cover  the  continental 
U.S.  This  accomplished  by  accessing  the  site  adaptation  data 
using  the  ASC.  With  the  ADAS  configured  in  this  way,  the  ITWS 
simulators  received  all  LDD  Flash  Messages.  This  allowed  for 
easier  verification  that  ADAS  properly  disseminated  LDD  Flash 
Messages  to  ITWS. 

The  IPS  was  configured  to  correspond  to  the  ADAS  configuration 
including  the  simulation  of  20  circuits  with  50  AWOS  stations. 
Simulated  circuit  connectivity  spreader  over  all  eight  ICCs,  with 
a  mixture  of  DMA  and  IRQ  SW  Handling  channels.  One  simulated 
channel  had  10  stations  (drops) .  The  other  19  channels  had  a 
total  of  40  stations.  The  reason  to  simulate  50  stations  was  to 
simulate  an  ADAS  operational  environment.  This  served  to  verify 
that  the  ADAS  SW/HW  could  properly  service,  in  compliance  with 
established  system  timing  constraints  and  throughput 
requirements.  Additionally,  the  IPS  was  configured  to  simulate 
WMSCR,  DLP,  and  WARP. 

An  LMPA  connected  in  series  with  the  ADAS/NLDN  Monitor  port.  The 
LMPA  data  captured  were  examined  to  verify  that  ADAS  properly 
received  "live"  LDD  data  messages  from  the  NLDN . 

4. 4. 5. 5. 2  Data  Reduction  and  Analysis  Method. 

The  data  file  on  the  PCI  that  captured  IPS  data  contained  the 
following: 

a.  HEX  display  printouts  for  ITWS1  AWOS  and  ITWS1  LDD. 

b.  ITWS  (1-6)  LDD  file  :  HT-05A.  I  ( 1-6)  LD 
ITWS (1-6)  AWOS  file:  iIT-05A. I ( 1-6) AW 
AWOS  MESSAGES  file:  OIT-05A.AWOS 

The  data  file  on  the  PC2  that  captured  ADAS  data  contained  the 
following: 

a.  The  NLDN  Communications  Datapoint. 

The  ITWS1  Communications  Datapoint. 

The  ITWS2  Communications  Datapoint. 

The  ITWS3  Communications  Datapoint. 

The  ITWS4  Communications  Datapoint. 

The  ITWS5  Communications  Datapoint. 

The  ITWS6  Communications  Datapoint. 

b.  05  --  EVENT  Log  for  status  of  the  AWOS/ASOS  connection 
had  changed. 

61  —  EVENT  Log  for  status  of  the  ITWS  connection  had 

changed. 

62  —  EVENT  Log  for  status  of  the  NLDN  connection  had 

changed. 
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c.  The  LMPA  data  captured  transferred  to  the  Data  Capture 
PC  (PC3 )  by  using  Procoimn  Plus  software.  The  file  named  is  IT- 
0  5 . Imp . 

The  IT-05. Imp  file  were  examined  to  verify  that  the  NLDN  properly 
interfaced  with  ADAS.  Verifications  consisted  of  the  ADAS  SW/HW 
which  properly  accepted  and  interpreted  the  NLDN  data  stream  with 
the  characteristics:  serial,  asynchronous,  1200-baud  rate,  8  data 
bits,  1  stop  bit,  and  no  parity. 

The  HEX  printouts  were  used  to  verify  that  ADAS/ITWSs  properly 
received  valid  LDD  input  messages: 

1.  ADU  maximum  size  did  not  exceed  4096  bytes  per  ADU, 

2.  The  single  ADU  contained  only  LDD  data, 

3.  The  ADU  WMO  (envelope  head,  abbreviated  heading  and 
tail)  containing  only  LDD  data  was  properly  formatted  and  fields 
were  correct, 

4.  The  single  ADU  contained  only  AWOS  data, 

5.  The  ADU  WMO  (envelope  head,  abbreviated  heading  and 
tail)  containing  only  AWOS  data  was  properly  formatted  and  fields 
were  correct. 

The  test  data  in  the  IT-05. Imp  file  and  the  ITWS (1-6)  LDD 
(IML) file  were  examined  to  verify  that  the  LDD  bound  for  ITWS 
moved  through  the  ADAS  within  5  seconds. 

The  test  data  in  the  AWOS  Messages  out  file  and  the  ITWS (1-6) 

AWOS  (IML)  file  were  examined  to  verify  that  the  OMO  bound  for 
six  ITWSs  moved  through  ADAS. 

Reviewed  the  ADAS  Event  Log  for  events  pertinent  to  this  test, 
particularly  Event  Types  (05,  61,  62). 

Reviewed  the  Communications  Datapoint  obtained  from  the  ADAS  SI 
to  verify  that  the  NLDN  and  the  ITWSs  properly  interfaced  with 
ADAS. 

For  this  test,  seven  out  of  seven  Evaluation  Criteria  passed. 

The  Evaluation  Criteria  used  to  determine  that  this  test's 
requirements  were  verified  are  contained  in  appendix  C. 

4. 4. 5. 5. 3  Results  and  Discussion. 

The  following  paragraphs:  contain  cross-reference  formal  test 
data;  provide  details  of  significant  problems  encountered  during 
test  execution;  and  list  the  status  of  OT&E  PTRs  generated  with 
respect  to  test  IT-05.  ' 
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4 . 4 . 5 . 5 . 3 . 1  Data . 

Due  to  the  volume  of  the  cross-referenced  test  data,  it  has  not 
been  included  in  this  paragraph.  The  data  has  been  included  in 
the  appendix  C  paragraph  associated  with  test  IT-05. 

4. 4. 5. 5. 3. 2  Significant  Problems. 

During  formal  test  runs,  the  IT-05  test  found  a  problem  similar 
to  the  one  identified  in  ADAS/Mods  Site  Issue  Report  #3  (refer  to 
ADAS /ALDARS  Test  PT-12),  and  resulted  in  the  generation  of  PTR 
OTE-016.  The  problem  is  associating  ITWS  Site  Ids,  the  correct 
ITWS  in  the  "Display  ITWS  Communications  Characteristics"  screen. 
The  ADAS  VDD  for  build  4.19  indicated  that  correction  of  this 
problem  has  been  deferred  to  the  ADAS  Year  2000  (Y2K)  Contract. 

4. 4. 5. 5. 3. 3  PTRs  Generated. 

See  appendix  B  for  complete  PTR  details.  The  PTRs  generated  with 
respect  to  this  test  are: 

Moderate  PTR(s) :  OTE-016  -  OPEN. 

4.4.5. 6  Test  IT-06. 

The  objective  of  ADAS/ALDARS  Regression  Test  IT-06  was  to  verify 
ADAS  functionality  was  not  adversely  impacted  by  the  ALDARS 
contract  modifications  to  the  previously  baselined  version  of  the 
ADAS  software.  This  functionality  test  verified  that  ADAS 
established  a  communications  link  with  the  ITWS  when  it  became 
active,  even  though  it  was  not  active  when  the  ADAS  application 
initialized  at  startup. 

4. 4. 5. 6.1  Description. 

The  IPS  test  started  with  the  ITWS  simulators  disabled.  The  ADAS 
system  started  and  during  the  initialization  phase  detected  ITWSs 
were  unavailable.  ADAS  continued  to  the  Operational  State, 
running  in  Reduced  Mode.  The  MPS  requested  the  RMS  Master  System 
Mode  Data  Point.  The  IPS  then  enabled  the  ITWS  simulators,  ADAS 
detected  the  ITWS  availability,  established  communications  with 
all  six  ITWSs,  and  switched  to  System  Mode  "Full."  The  IPS  then 
prompted  the  operator  to  login,  request  a  report  for  event  type 
1,  logout,  then  acknowledge  the  IPS  prompt.  When  the  prompt  was 
acknowledged,  the  IPS  terminated  the  test. 

4. 4. 5. 6. 2  Data  Reduction  and  Analysis  Method. 

Test  IT-06' s  relevant  OT&E  formal  test  run  data  has  been 
incorporated  into  its  TCF  and  marked  with  the  evaluation _ criteria 
cross-reference  numbers.  The  evaluation  criteria,  modified  to 
past-tense,  and  the  cross-referenced  test  data  from  IT-06' s  TCF 
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are  included  below  in  this  report.  See  appendix  C  paragraph  for 
test  IT-06  for  the  completed  TCF  procedure  steps. 

For  this  test,  four  out  of  four  Evaluation  Criteria  passed.  The 
Evaluation  Criteria  used  to  determine  that  this  test's 
requirements  were  verified  are  contained  in  appendix  C. 

4. 4. 5. 6. 3  Results  and  Discussion. 

The  following  paragraphs:  contain  cross-reference  formal  test 
data;  provide  details  of  significant  problems  encountered  during 
test  execution;  and  list  the  status  of  OT&E  PTRs  generated  with 
respect  to  test  IT-06. 

4 . 4 . 5 . 6 . 3 . 1  Data . 

Due  to  the  volume  of  the  cross-referenced  test  data,  it  has  not 
been  included  in  this  paragraph.  The  data  has  been  included  in 
the  appendix  C,  IT-06  section. 

4.4.5. 6.3.2  Significant  Problems. 

None 

4.4.5. 6.3.3  PTRs  Generated. 

None 

4.4.6  Category  MP  -  Maintenance  Processing  Tests. 

Testing  of  ADAS’ s  RMS  was  performed  by  the  MPS  group,  ACT-330. 
Refer  to  the  MPS  group's  test  report,  included  as  appendix  D  to 
this  report. 

4.4.7  Category  OP  -  Operational  Tests. 

4. 4. 7.1  Test  QP-01 . 

The  objective  of  ADAS/ALDARS  Regression  Test  OP-01  was  to  verify 
ADAS  functionality  was  not  adversely  impacted  by  the  ALDARS 
contract  modifications  to  the  previously  baselined  version  of  the 
ADAS  software.  This  functionality  test  verified  ADAS: 
successfully  achieved  an  uninterrupted  startup;  successfully 
achieved  a  graceful  shut  down;  provided  SI  control  during  the 
initialization  state;  generated  entries  in  the  System  Event  log 
recording  SI  shut  down  request;  and,  shuts  down  without  logging 
any  event  type  42  (CSC  Error). 

4. 4. 7. 1.1  Description. 

The  ADAS  system  proceeded  from  the  shut  down  state,  to  the 
operational  state,  without  operator  intervention.  After  ADAS 
sent  a  system  update  to  the  MPS,  the  shut  down  command  was 
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issued.  The  ADAS  was  restarted  and  the  test  operator  accessed 
the  SI  while  ADAS  was  in  the  initialization  state.  The  operator 
altered  several  of  the  Adaptation  Parameters  and  issued  the 
Continue  ADAS.  The  operator  was  prompted  for  the  type  of  start 
mode,  selected  the  cold  start  mode,  confirmed  the  selection,  and 
proceeded  to  the  operational  state.  After  ADAS  sent  a  system 
update  to  the  MPS,  operator  shut  down  the  ADAS  using  the  SI. 

4. 4. 7. 1.2  Data  Reduction  and  Analysis  Method. 

Test  OP-01 ' s  relevant  OT&E  formal  test  run  data  has  been 
incorporated  into  its  TCF  and  marked  with  the  evaluation  criteria 
cross-reference  numbers.  The  evaluation  criteria,  modified  to 
past-tense,  and  the  cross-referenced  test  data  from  OP-01' s  TCF 
are  included  below  in  this  report.  See  appendix  C  paragraph  for 
test  OP-01  for  the  completed  TCF  procedure  steps. 

For  this  test,  six  out  of  six  Evaluation  Criteria  passed.  The 
Evaluation  Criteria  used  to  determine  that  this  test's 
requirements  were  verified  are  contained  in  appendix  C. 

4. 4. 7. 1.3  Results  and  Discussion. 

The  following  paragraphs:  contain  cross-reference  formal  test 
data;  provide  details  of  significant  problems  encountered  during 
test  execution;  and  list  the  status  of  OT&E  PTRs  generated  with 
respect  to  test  OP-01. 

4. 4. 7. 1.3.1  Data. 

Due  to  the  volume  of  the  cross-referenced  test  data,  it  has  not 
been  included  in  this  paragraph.  The  data  has  been  included  in 
the  appendix  C,  'OP-01'  section. 

4. 4. 7. 1.3. 2  Significant  Problems. 

As  detailed  in  PTR  OTE-Oll,  during  OT&E  #1  formal  test  runs,  if 
an  IPS  test  is  simulating  live  interfaces,  the  ADAS  would  lock  up 
when  a  graceful  shut  down  was  requested.  IPS  status  messages  at 
the  IPS  Unix  Console  (IUC)  indicated  the  ITWS  interfaces  were  not 
being  terminated.  DME  analysis  determined  the  new  ITWS 
communication  processes  had  not  been  added  to  a  table  accessed  by 
ADAS  during  shut  down  processing.  During  OT&E  #2  formal  test 
runs,  the  ADAS  gracefully  shut  down  upon  request  under  all 
conditions . 

4. 4. 7. 1.3. 3  PTRs  Generated. 

See  appendix  B  for  complete  details  of  all  PTRs  generated  during 
OT&E  testing.  The  PTRs  generated  with  respect  to  OT&E  formal 
test  runs  of  test  IN-01  were: 

Critical:  OTE-Oll  -  CLOSED 
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4. 4. 7. 2  Test  QP-02, 

The  objective  of  ADAS/ALDARS  Regression  Test  OP-02  was  to  verify 
ADAS  functionality  was  not  adversely  impacted  by  the  ALDARS 
contract  modifications  to  the  previously  baselined  version  of  the 
ADAS  software.  This  functionality  test  verified  that  the  ADAS 
system  automatically  restarted  and  used  previously  stored 
maintenance  and  weather  threshold  data  when  it  was  available. 

The  following  functionality  was  demonstrated  by  this  test:  the 
"startup"  datapoint  indicates  a  warm  start  overall;  the  METAR 
generation  datapoint  indicates  all  Specials  that  were  generated; 
and  the  METAR  message  arriving  at  WMSCR  after  the  warm  start 
contains  the  thunderstorm  begin  additive  data. 

4. 4. 7. 2.1  Description. 

ADAS  was  allowed  to  run  normally  for  two  mission  cycles, 
generating  a  known  data  store,  and  then  a  critical  communications 
task  (Communications  Control.-  CCN)  was  intentionally  terminated, 
causing  ADAS  to  automatically  shut  down  and  restart.  ADAS 
restarted,  using  the  stored  threshold  and  checkpoint  data,  and 
returned  to  the  operational  state. 

4. 4. 7. 2. 2  Data  Reduction  and  Analysis  Method. 

Test  OP-02' s  relevant  OT&E  formal  test  run  data  has  been 
incorporated  into  its  TCF  and  marked  with  the  evaluation  criteria 
cross-reference  numbers.  The  evaluation  criteria,  modified  to 
past-tense,  and  the  cross-referenced  test  data  from  OP-02 ' s  TCF 
are  included  below  in  this  report.  (See  appendix  C  paragraph  for 
test  OP-02  for  the  completed  TCF  procedure  steps.) 

For  this  test,  four  out  of  four  Evaluation  Criteria  passed.  The 
Evaluation  Criteria  used  to  determine  that  this  test's 
requirements  were  verified  are  contained  in  appendix  C. 

4. 4. 7. 2. 3  Results  and  Discussion . 

The  following  paragraphs:  contain  cross-reference  formal  test 
data;  provide  details  of  significant  problems  encountered  during 
test  execution;  and  list  the  status  of  OT&E  PTRs  generated  with 
respect  to  test  OP-02. 

4 . 4 . 7 . 2 . 3 . 1  Data . 

Due  to  the  volume  of  the  cross-referenced  test  data,  it  has  not 
been  included  in  this  paragraph.  The  data  has  been  included  in 
the  appendix  C,  ’OP-02'  section. 

4. 4. 7. 2. 3. 2  Significant  Problems. 

None 
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4. 4. 7. 2. 3. 3  PTRs  Generated. 

None 

4. 4. 7. 3  Test  QP-03. 

The  objective  of  ADAS/ALDARS  Regression  Test  OP-03  was  to  verify 
ADAS  functionality  was  not  adversely  impacted  by  the  ALDARS 
contract  modifications  to  the  previously  baselined  version  of  the 
ADAS  software.  This  functionality  test  verified  that  the  ADAS 
system  automatically  restarted  when  previously  stored  maintenance 
and  weather  threshold  data  was  unavailable.  This  functionality 
test  verified:  the  initialization  mode  datapoint  indicates  an 
overall  Cold  Start  occurred;  the  METAR  special  generation 
datapoint  indicates  only  the  number  of  METAR  specials  generated 
after  the  restart;  the  METAR  messages  arriving  at  the  WMSCR 
simulator  after  the  restart  do  not  contain  the  thunderstorm  begin 
additive  data. 

4. 4. 7. 3.1  Description. 

ADAS  generated  a  known  data  store  before:  a  critical 
communications  task  (Communications  Control  -  CCN)  was 
intentionally  terminated,  causing  ADAS  to  shut  down;  and  both 
weather  and  maintenance  checkpoint  data  stores  were  removed. 

ADAS  restarted  without  the  checkpoint  data  and  continued  to  the 
operational  state.  After  a  METAR  Special  was  generated, 
datapoint  information  was  retrieved. 

4. 4. 7. 3. 2  Data  Reduction  and  Analysis  Method. 

Test  OP-03 ' s  relevant  OT&E  formal  test  run  data  has  been 
incorporated  into  its  TCF  and  marked  with  the  evaluation  criteria 
cross-reference  numbers.  The  evaluation  criteria,  modified  to 
past-tense,  and  the  cross-referenced  test  data  from  OP-03' s  TCF 
are  included  below  in  this  report.  See  appendix  C  paragraph  for 
test  OP-03  for  the  completed  TCF  procedure  steps. 

For  this  test,  four  out  of  four  Evaluation  Criteria  passed.  The 
Evaluation  Criteria  used  to  determine  that  this  test's 
requirements  were  verified  are  contained  in  appendix  C.  ■ 

4. 4. 7. 3. 3  Results  and  Discussion. 

The  following  paragraphs:  contain  cross-reference  formal  test 
data;  provide  details  of  significant  problems  encountered  during 
test  execution;  and  list  the  status  of  OT&E  PTRs  generated  with 
respect  to  test  OP-03. 
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4 . 4 . 7 . 3 . 3 . 1  Data . 

Due  to  the  volume  of  the  cross-referenced  test  data,  it  has  not 
been  included  in  this  paragraph.  The  data  has  been  included  in 
the  appendix  C,  'OP-03'  section. 

4. 4. 7. 3. 3. 2  Significant  Problems. 

None 

4. 4. 7. 3. 3. 3  PTRs  Generated. 

None 

4. 4. 7. 4  Test  QP-04. 

The  objective  of  ADAS/ALDARS  Regression  Test  OP-04  was  to  verify 
ADAS  functionality  was  not  adversely  impacted  by  the  ALDARS 
contract  modifications  to  the  previously  baselined  version  of  the 
ADAS  software.  This  functionality  test  verified  that  the  ADAS 
system  automatically  restarts  without  previously  stored  weather 
threshold  data.  This  test  verified:  the  initialization  mode 
datapoint  indicates  a  Maintenance  Warm  Start  occurred;  the  METAR 
special  generation  datapoint  indicates  METAR  specials  generated 
before  and  after  the  restart;  and  the  METAR  messages  arriving  at 
the  WMSCR  simulator  after  the  Shut  down  do  not  indicate  that  a 
thunderstorm  begin  was  encoded. 

4. 4. 7. 4.1  Description. 

ADAS  was  brought  to  the  Operational  state.  ADAS  received  a 
thunderstorm  begin  AWOS  message  to  produce  an  increment  in  at 
least  one  Software  Data  Point  and  processing  of  additive  weather 
data.  A  critical  communications  task  (Communications  Control  - 
CCN)  was  intentionally  terminated,  causing  ADAS  to  shut  down,  and 
the  weather  checkpoint  data  store  was  removed.  ADAS  then 
restarted  without  the  weather  threshold  data.  ADAS  then 
continued  to  the  operational  state.  After  another  METAR  Special 
was  generated,  the  datapoint  information  was  retrieved. 

4. 4. 7. 4. 2  Data  Reduction  and  Analysis  Method. 

Test  OP-04 's  relevant  OT&E  formal  test  run  data  has  been 
incorporated  into  its  TCF  and  marked  with  the  evaluation  criteria 
cross-reference  numbers.  The  evaluation  criteria,  modified  to 
past-tense,  and  the  cross-referenced  test  data  from  OP-04' s  TCF 
are  included  below  in  this  report.  See  appendix  C  paragraph  for 
test  OP-04  for  the  completed  TCF  procedure  steps. 

For  this  test,  four  out  of  four  Evaluation  Criteria  passed.  The 
Evaluation  Criteria  used  to  determine  that  this  test's 
requirements  were  verified  are  contained  in  appendix  C. 
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4. 4. 7. 4. 3  Results  and  Discussion. 

The  following  paragraphs:  contain  cross-reference  formal  test_ 
data;  provide  details  of  significant  problems  encountered  during 
test  execution;  and  list  the  status  of  OT&E  PTRs  generated  with 
respect  to  test  OP-04. 

4 . 4 . 7 . 4 . 3 . 1  Data . 

Due  to  the  volume  of  the  cross-ref erenced  test  data,  it  has  not 
been  included  in  this  paragraph.  The  data  has  been  included  in 
the  appendix  C,  'OP-04'  section. 

4. 4. 7. 4. 3. 2  Significant  Problems .  . 

None 

4.417.4.3.3  PTRs  Generated . 

None 

4, 4. 7. 5  Test  QP-05. 

The  objective  of  ADAS/ALDARS  Regression  Test  OP-05  was  to  verify 
ADAS  functionality  was  not  adversely  impacted  by  the  ALDARS 
contract  modifications  to  the  previously  baselined  version  of  the 
ADAS  software.  This  functionality  test  verified  that  the  ADAS 
system  automatically  restarted  without  previously  stored 
maintenance  threshold  data.  This  test  verified:  the 
initialization  mode  datapoint  indicates  a  Weather  Warm  Start 
occurred;  the  Metar  specials  generation  datapoint  indicates  that 
two  METAR  specials  were  generated;  METAR  messages  arriving  at  the 
WMSCR  simulator  after  the  restart  encode  a  thunderstorm  begin. 

4.4. 7. 5.1  Description. 

ADAS  was  brought  to  the  Operational  state.  ADAS  received  a 
thunderstorm  begin  AWOS  message  to  produce  an  increment  in  the 
software  datapoint  and  the  processing  of  additive  weather  data. 

A  critical  communications  task  (CCN)  was  intentionally 
terminated,  causing  ADAS  to  shut  down,  and  the  maintenance 
checkpoint  data  store  was  removed.  ADAS  restarted  without  the 
maintenance  threshold  data.  ADAS  continued  to  the  operational 
state,  another  METAR  Special  was  generated,  and  datapoint 
information  was  retrieved. 

4. 4. 7. 5.2  Data  Reduction  and  Analysis  Method. 

Test  OP-05 's  relevant  OT&E  formal  test  run  data  has  been 
incorporated  into  its  TCF  and  marked  with  the  evaluation  criteria 
cross-reference  numbers.  The  evaluation  criteria,  modified  to 
past-tense,  and  the  cross-referenced  test  data  from  OP-05' s  TCF 
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are  included  below  in  this  report.  See  appendix  C  paragraph  for 
test  OP-05  for  the  completed  TCF  procedure  steps. 

For  this  test,  four  out  of  four  Evaluation  Criteria  passed.  The 
Evaluation  Criteria  used  to  determine  that  this  test's 
requirements  were  verified  are  contained  in  appendix  C. 

4. 4. 7. 5. 3  Results  and  Discussion. 

The  following  paragraphs:  contain  cross-reference  formal  test 
data;  provide  details  of  significant  problems  encountered  during 
test  execution;  and  list  the  status  of  OT&E  PTRs  generated  with 
respect  to  test  OP-05. 

4 . 4 . 7 ♦ 5 . 3 ♦ 1  Data . 

Due  to  the  volume  of  the  cross-referenced  test  data,  it  has  not 
been  included  in  this  paragraph.  The  data  has  been  included  in 
the  appendix  C,  ? OP-05 1  section. 

4. 4. 7. 5. 3. 2  Significant  Problems. 

None 

4. 4. 7. 5. 3. 3  PTRs  Generated. 

None 

4.4.7. 6  Test  QP-06. 

The  objective  of  ADAS/ALDARS  Regression  Test  OP-06  was  to  verify 
ADAS  functionality  was  not  adversely  impacted  by  the  ALDARS 
contract  modifications  to  the  previously  baselined  version  of  the 
ADAS  software..  This  functionality  test  verified  that  the  ADAS 
system  could  be  manually  restarted  using  previously  stored 
threshold  data.  The  test  verified:  the  initialization  mode 
datapoint  indicates  an  Overall  Warm  Start  occurred;  the  METAR 
special  generation  datapoint  indicates  all  METAR  specials 
generated  before  and  after  the  restart;  METAR  messages  arriving 
at  the  WMSCR  simulator  after  the  restart  encoded  a  thunderstorm 
begin. 

4.4.7. 6.1  Description. 

ADAS  received  a  thunderstorm  begin  AWOS  message  to  produce  an 
increment  in  at  least  one  Software  Data  Point  and  processing  of 
additive  weather  data  and  then  the  ASC  was  used  to  gracefully 
shut  down  ADAS.  ADAS  was  restarted,  and  the  test  operator  logged 
in  during  the  initialization  state  and  issued  a  warm  start 
request  to  continue  to  the  operational  state.  After  the  warm 
start,  the  AWOS  station  sent  another  message  to  trigger  ADAS 
generation  of  a  METAR  special.  Verification  was  verified  by 
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examination  of  the  initialization  datapoint  and  generated  Speci 
from  before  and  after  the  restart. 

4.4.7. 6.2  Data  Reduction  and  Analysis  Method. 

Test  OP-06 ' s  relevant  OT&E  formal  test  run  data  has  been 
incorporated  into  its  TCF  and  marked  with  the  evaluation  criteria 
cross-reference  numbers.  The  evaluation  criteria,  modified  to 
past-tense,  and  the  cross-ref erenced  test  data  from  OP-06' s  TCF 
are  included  below  in  this  report.  See  appendix  C  paragraph  for 
test  OP-06  for  the  completed  TCF  procedure  steps. 

For  this  test,  four  out  of  four  Evaluation  Criteria  passed.  The 
Evaluation  Criteria  used  to  determine  that  this  test' s 
requirements  were  verified  are  contained  in  appendix  C. 

4.4.7'. 6. 3  Results  and  Discussion. 

The  following  paragraphs:  contain  cross-reference  formal  test . 
data;  provide  details  of  significant  problems  encountered  during 
test  execution;  and  list  the  status  of  OT&E  PTRs  generated  with 
respect  to  test  OP-06. 

4 . 4 . 7 . 6 . 3 . 1  Data . 

Due  to  the  volume  of  the  cross-referenced  test  data,  it  has  not 
been  included  in  this  paragraph.  The  data  has  been  included  in 
the  appendix  C,  ’OP-06'  section. 

4. 4. 7. 6. 3. 2  Significant  Problems. 

None 

4 . 4 . 7 . 6 . 3 . 3  PTRs  Generated . 

None 

4. 4. 7. 7  Test  QP-07. 

The  objective  of  ADAS/ALDARS  Regression  Test  OP-07  was  to  verify 
ADAS  functionality  was  not  adversely  impacted  by  the  ALDARS 
contract  modifications  to  the  previously  baselined  version  of  the 
ADAS  software.  This  functionality  test  verified  that  the  ADAS 
system  could  be  manually  restarted  without  using  previously 
stored  threshold  data.  The  test  verified:  the  initialization 
mode  datapoint  indicates  an  Overall  Cold  Start  occurred;  the 
METAR  special  generation  datapoint  indicates  only  METAR  specials 
generated  after  the  restart;  METAR  messages  arriving  at  the  WMSCR 
simulator  after  the  restart  do  not  encode  a  thunderstorm  begin. 
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4. 4. 7. 7.1  Description. 

ADAS  received  a  thunderstorm  begin  AWOS  message  to  produce  an 
increment  in  at  least  one  Software  Data  Point  and  processing  of 
additive  weather  data,  and  then  the  ASC  was  used  to  gracefully 
shut  down  ADAS.  ADAS  was  restarted,  the  test  operator  logged  in 
during  the  initialization  state  and  issued  a  request  to  proceed 
with  a  cold  start.  After  the  cold  start,  the  AWOS  station  sent  a 
message  to  trigger  ADAS  generation  an  METAR  special  when 
processed  by  ADAS.  Verification  was  verified  by  examination  of 
the  initialization  datapoint  and  generated  Speci  from  before  and 
after  the  restart. 

4. 4. 7. 7. 2  Data  Reduction  and  Analysis  Method. 

Test  OP-07' s  relevant  OT&E  formal  test  run  data  has  been 
incorporated  into  its  TCF  and  marked  with  the  evaluation  criteria 
cross-reference  numbers.  The  evaluation  criteria,  modified  to 
past-tense,  and  the  cross-referenced  test  data  from  OP-07 's  TCF 
are  included  below  in  this  report.  See  appendix  C  paragraph  for 
test  OP-07  for  the  completed  TCF  procedure  steps. 

For  this  test,  five  out  of  five  Evaluation  Criteria  passed.  The 
Evaluation  Criteria  used  to  determine  that  this  test's 
requirements  were  verified  are  contained  in  appendix  C. 

4. 4. 7. 7. 3  Results  and  Discussion. 

The  following  paragraphs:  contain  cross-reference  formal  test 
data;  provide  details  of  significant  problems  encountered  during 
test  execution;  and  list  the  status  of  OT&E  PTRs  generated  with 
respect  to  test  OP-07. 

4 . 4 . 7 . 7 . 3 . 1  Data . 

Due  to  the  volume  of  the  cross-referenced  test  data,  it  has  not 
been  included  in  this  paragraph.  The  data  has  been  included  in 
the  appendix  C,  ’ OP-07'  section. 

4. 4. 7. 7. 3. 2  Significant  Problems . 

None 

4. 4. 7. 7. 3. 3  PTRs  Generated . 

None 

4. 4. 7. 8  Test  QP-08. 

The  objective  of  ADAS/ALDARS  Regression  Test  OP-08  was  to  verify 
ADAS  functionality  was  not  adversely  impacted  by  the  ALDARS 
contract  modifications  to  the  previously  baselined  version  of  the 
ADAS  software.  This  functionality  test  verified  that  the  ADAS 
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system  could  be  manually  restarted  using  previously  stored 
Maintenance  threshold  data.  The  test  verified:  the 
initialization  mode  datapoint  indicates  a  Maintenance  Warm  Start 
occurred;  the  METAR  special  generation  datapoint  indicates  all 
METAR  specials  generated  before  and  after  the  restart;  METAR 
messages  arriving  at  the  WMSCR  simulator  after  the  restart  does 
not  encode  a  thunderstorm  begin. 

4. 4. 7. 8.1  Description. 

ADAS  received  a  thunderstorm  begin  AWOS  message  to  produce  an 
increment  in  at  least  one  Software  Data  Point  and  processing  of 
additive  weather  data  and  then  the  ASC  was  used  to  gracefully 
shut  down  ADAS.  ADAS  was  restarted,  and  the  test  operator  logged 
in  during  the  initialization  state  and  issued  a  maintenance  warm 
start  request  to  continue  to  the  operational  state.  After  the 
Maintenance  Warm  Start,  the  AWOS  station  sent  another  message  to 
trigger  ADAS  generation  of  a  METAR  special.  Verification  was 
verified  by  examination  of  the  initialization  datapoint  and 
generated  Speci  from  before  and  after  the  restart. 

4. 4. 7. 8. 2  Data  Reduction  and  Analysis  Method. 

Test  OP-08 ' s  relevant  OT&E  formal  test  run  data  has  been 
incorporated  into  its  TCF  and  marked  with  the  evaluation  criteria 
cross-reference  numbers.  The  evaluation  criteria,  modified  to 
past-tense,  and  the  cross-referenced  test  data  from  OP-08 's  TCF 
are  included  below  in  this  report.  See  appendix  C  paragraph  for 
test  OP-08  for  the  completed  TCF  procedure  steps. 

For  this  test,  four  out  of  four  Evaluation  Criteria  passed.  The 
Evaluation  Criteria  used  to  determine  that  this  test' s 
requirements  were  verified  are  contained  in  appendix  C. 

4. 4. 7. 8. 3  Results  and  Discussion. 

The  following  paragraphs:  contain  cross-reference  formal  test 
data;  provide  details  of  significant  problems  encountered  during 
test  execution;  and  list  the  status  of  OT&E  PTRs  generated  with 
respect  to  test  OP-08. 

4 . 4 . 7 . 8 . 3 . 1  Data . 

Due  to  the  volume  of  the  cross-referenced  test  data,  it  has  not 
been  included  in  this  paragraph.  The  data  has  been  included  in 
the  appendix  C,  'OP-08'  section. 

4. 4. 7. 8. 3. 2  Significant  Problems. 

None 
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4. 4. 7. 8. 3. 3  PTRs  Generated . 

None 

4. 4. 7. 9  Test  QP-09. 

The  objective  of  ADAS/ALDARS  Regression  Test  OP-09  was  to  verify 
ADAS  functionality  was  not  adversely  impacted  by  the  ALDARS 
contract  modifications  to  the  previously  baselined  version  of  the 
ADAS  software.  This  functionality  test  verified  that  the  ADAS 
system  could  be  manually  restarted  using  previously  stored 
threshold  data.  The  test  verified:  the  initialization  mode 
datapoint  indicates  a  Weather  Warm  Start  occurred;  the  METAR 
special  generation  datapoint  indicates  only  METAR  specials 
generated  after  the  restart;  and  METAR  messages  arriving  at  the 
WMSCR  simulator  after  the  restart  encoded  a  thunderstorm  begin. 

4. 4. 7. 9.1  Description. 

ADAS  received  a  thunderstorm'  begin  AWOS  message  to  produce  an 
increment  in  at  least  one  Software  Data  Point  and  processing  of 
additive  weather  data  and  then  the  ASC  was  used  to  gracefully 
shut  down  ADAS.  ADAS  was  restarted,  and  the  test  operator  logged 
in  during  the  initialization  state  and  issued  a  weather  warm 
start  request  to  continue  to  the  operational  state.  After  the 
Weather  Warm  Start,  the  AWOS  station  sent  another  message  to 
trigger  ADAS  generation  of  a  METAR  special.  Verification  was 
verified  by  examination  of  the  initialization  datapoint  and 
generated  Speci  from  before  and  after  the  restart. 

4. 4. 7. 9. 2  Data  Reduction  and  Analysis  Method . 

Test  OP-09' s  relevant  OT&E  formal  test  run  data  has  been 
incorporated  into  its  TCF  and  marked  with  the  evaluation  criteria 
cross-reference  numbers.  The  evaluation  criteria,  modified  to 
past-tense,  and  the  cross-referenced  test  data  from  OP-09' s  TCF 
are  included  below  in  this  report.  See  appendix  C  paragraph  for 
test  OP-09  for  the  completed  TCF  procedure  steps. 

For  this  test,  four  out  of  four  -Evaluation  Criteria  passed.  The 
Evaluation  Criteria  used  to  determine  that  this  test's 
requirements  were  verified  are  contained  in  appendix  C. 

4. 4. 7. 9. 3  Results  and  Discussion. 

The  following  paragraphs:  contain  cross-reference  formal  test 
data;  provide  details  of  significant  problems  encountered  during 
test  execution;  and  list  the  status  of  OT&E  PTRs  generated  with 
respect  to  test  OP-09. 
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4 . 4 . 7 . 9 . 3 . 1  Data . 


Due  to  the  volume  of  the  cross-referenced  test  data,  it  has  not 
been  included  in  this  paragraph.  The  data  has  been  included  in 
the  appendix  C,  'OP-09'  section. 

4. 4. 7. 9. 3. 2  Significant  Problems. 

None 

4. 4. 7. 9. 3. 3  PTRs  Generated. 

None 

4.4.7.10  Tests  QP-10  and  OP-11  -  ASC  Display  Test. 

The  objective  of  the  ADAS/ALDARS  Regression  Tests  OP-10  and  OP-11 
was  to  verify  ADAS  functionality  was  not  adversely  impacted  by 
the  ALDARS  contract  modifications  to  the  previously  baselined 
version  of  the  ADAS  software. 

4.4.7.10.1  Description. 

Test  OP-10  examines  every  ASC  display  screen,  and  associated 
context-sensitive  help  screen,  for  format  and  content.  Test 
OP-11,  a  subset  of  OP-10,  was  redundant  and  has  been  retired. 

4.4.7.10.2  Data  Reduction  and  Analysis  Method. 

Failure  seen  when  displaying  any  "edit  adaptation  datapoint 
threshold"  screen. 

4.4.7.10.3  Results  and  Discussion. 

4.4.7.10.3.1  Data. 

Refer  to  appendix  C  for  the  TCF  for  test  OP-10. 

4.4.7.10.3.2  Significant  Problems. 

Baselining  of  the  ADAS  software  prior  to  the  ALDARS  modifications 
revealed  that  the  help  system  displays  incorrect  context 
sensitive  help  screens.  The  correction  of  this  problem  should  be 
incorporated  into  the  ADAS  Y2K  contract.  . 

4.4.7.10.3.3  PTRs  Generated. 

See  appendix  B  for  complete  details  of  all  PTRs  generated  during 
OT&E  testing.  The  PTRs  generated  with  respect  to  OT&E  formal 
test  runs  of  test  OP-10  were: 

Moderate:  OTE-045  -  OPEN 
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4.4.7.11  Test  OP-13. 


The  objective  of  ADAS/ALDARS  Regression  Test  OP-13  was  to  verify 
ADAS  functionality  was  not  adversely  impacted  by  the  ALDARS 
contract  modifications  to  the  previously  baselined  version  of  the 
ADAS  software.  This  functionality  test  verified:  that  for  the 
events  contained  in  the  ADAS  Event  log  each  entry  contains  the 
event  number,  date/time,  priority,  and  description;  each  of  the 
errors  returned  by  DLP  generated  an  event  type  21;  a  noncritical 
event  priority  was  indicated;  and  the  event  description 
accurately  identified  the  event. 

In  addition  to  operationally  testing  Event  Log  processing,  this 
procedure  also  provided  test  data  for  the  verification  of  the 
correction  TSC  Site  Issue  #4,  included  in  the  test  procedures  as 
test  PT-13 . 

4.4.7.11.1  Description . 

This  procedure  validated  the  correctness  of  normal  (noncritical) 
Event  log  processing.  This  was  achieved  by  DLP  reporting  an 
error  each  time  it  received  a  message  from  ADAS  to  trigger  the 
event  type  21  entries.  At  the  end  of  the  test,  the  operator 
requested  an  Event  Log  report  for  event  types  21. 

4.4.7.11.2  Data  Reduction  and  Analysis  Method. 

Test  OP-13' s  relevant  OT&E  formal  test  run  data  has  been 
incorporated  into  its  TCF  and  marked  with  the  evaluation  criteria 
cross-reference  numbers'.  The  evaluation  criteria,  modified  to 
past-tense,  and  the  cross-referenced  test  data  from  OP-13 's  TCF 
are  included  below  in  this  report.  See  appendix  C  paragraph  for 
test  OP-13  for  the  completed  TCF  procedure  steps. 

For  this  test,  six  out  of  six  Evaluation  Criteria  passed.  The 
Evaluation  Criteria  used  to  determine  that  this  test's 
requirements  were  verified  are  contained  in  appendix  C. 

4.4.7.11.3  Results  and  Discussion. 

The  following  paragraphs:  contain  cross-reference  formal  test 
data;  provide  details  of  significant  problems  encountered  during 
test  execution;  and  list  the  status  of  OT&E  PTRs  generated  with 
respect  to  test  OP-13. 

4.4,7.11.3.1  Data. 

Due  to  the  volume  of  the  cross-referenced  test  data,  it  has  not 
been  included  in  this  paragraph.  The  data  has  been  included  in 
the  appendix  C,  'OP-13'  section. 
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4.4.7.11.3.2  Significant  Problems.  : 

The  ADAS  did  not  generate  any  events  of  type  49  to  indicate  the 
generation  of  Metar  SPECI  messages.  This  modification  was 
incorporated  by  DME  at  the  direction  of  the  ADAS  Program  Office. 
The  ADAS  Specification,  FAA-E-2804,  states  in  paragraph 

3. 1.4. 3. 1.1  that  all  significant  ADAS  system  events  shall  be 
recorded  in  the  system  event  log.  ADAS  generation  of  Metar 
format  messages  for  AWOS  sites  is  one  of  ADAS '  s  most  significant 
functions,  and  it  is  ACT-320' s  opinion  that  AWOS  message 
triggering  of  Metar  message  generation  is  a  significant  event  and 
should  be  recorded  in  the  system  event  log. 

4.4.7.11.3.3  PTRs  Generated. 

See  appendix  B  for  complete  details  of  all  PTRs  generated  during 
OT&E  testing.  The  PTRs  generated  with  respect  to  OT&E  formal 
test  runs  of  test  OP-13  were: 

Moderate:  OTE-014  -  Open 

4.4.7.12  Test  OP-14. 

The  objective  of  ADAS/ALDARS  Regression  Test  OP-14  was  to  verify 
ADAS  functionality  was  not  adversely  impacted  by  the  ALDARS 
contract  modifications  to  the  previously  baselined  version  of  the 
ADAS  software.  This  functionality  test  validates  the  correctness 
of  extraordinary  event  log  processing.  This  test  verified:  that 
the  ADAS  Event  log  indicates  CTS  time  shift  events,  AWOS  error 
response  events,  and  WMSCR  communications  status  change  events; 
that  each  event  indicates  its  priority;  and  that  the  descriptions 
accurately  describe  the  event. 

4.4.7.12.1  Description. 

Verification  was  achieved  by  shifting  the  CTS  time  signal  forward 
by  5  minutes,  reporting  AWOS  ADU  errors  to  ADAS,  and  disabling 
the  WMSCR  simulator  for  a  period  of  30  seconds.  The  IPS  then 
prompted  the  user  to  report  related  ADAS  Event  Log  entries. 

4.4.7.12.2  Data  Reduction  and  Analysis  Method. 

Test  OP-14 's  relevant  OT&E  formal  test  run  data  has  been 
incorporated  into  its  TCF  and  marked  with  the  evaluation  criteria 
cross-reference  numbers.  The  evaluation  criteria,  modified  to 
past-tense,  and  the  cross-referenced  test  data  from  OP-14' s  TCF 
are  included  below  in  this  report.  See  appendix  C  paragraph  for 
test  OP-14  for  the  completed  TCF  procedure  steps. 

For  this  test,  six  out  of  six  Evaluation  Criteria  passed.  The 
Evaluation  Criteria  used  to  determine  that  this  test's 
requirements  were  verified  are  contained  in  appendix  C. 
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4.4.7.12.3  Results  and  Discussion. 

The  following  paragraphs:  contain  cross-reference  formal  test 
data;  provide  details  of  significant  problems  encountered  during 
test  execution;  and  list  the  status  of  OT&E  PTRs  generated  with 
respect  to  test  OP-14. 

4.4.7.12.3.1  Data. 

Due  to  the  volume  of  the  cross-referenced  test  data,  it  has  not 
been  included  in  this  paragraph.  The  data  has  been  included  in 
the  appendix  C,  'OP-14'  section. 

4.4.7.12.3.2  Significant  Problems. 

The  ADAS  System  Specif ication  states  in  paragraph  3. 1.4. 3. 1.3 
that  all  significant  events  are  to  be  recorded  by  the  system 
event  logging  function.  As  ADAS  generation  of  Metar  format 
messages  for  AWOS  sites  is  one  of  ADAS' s  primary  functions, 
ACT-320  believes  the  generation  of  Metar  messages  are  significant 
events  and  should  trigger. the  generation  of  event  type  49  events. 
ACT-320  recommends  further  discussion  between  AUA-430,  AOS-530, 
and  ACT-320  to  resolve  the  event  type  49  issue. 

4.4.7.12.3.3  PTRs  Generated. 

See  appendix  B  for  complete  details  of  all  PTRs  generated  during 
OT&E  testing.  The  PTRs  generated  with  respect  to  OT&E  formal 
test  runs  of  test  OP-14  were: 

Moderate:  OTE-014  -  Open 

4.4.7.13  Test  OP-15. 

The  objective  of  ADAS/ALDARS  Regression  Test  OP-15  was  to  verify 
ADAS  functionality  was  not  adversely  impacted  by  the  ALDARS 
contract  modifications  to  the  previously  baselined  version  of  the 
ADAS  software.  This  functionality  test  verified  operation  of  the 
datapoint  alarm  (&  alert)  on  (&  off)  and  reset  commands.  The 
test  verified:  datapoints  with  altered  thresholds  and  disabled 
Alarm/Alert  did  not  report  an  Alarm/Alert  to  the  ASC;  datapoints 
with  altered  thresholds  and  re-enabled  Alarm/Alert  did  report  an 
Alarm/Alert  to  the  ASC;  the  counter  style  datapoints  in  Alarm  or 
Alert,  when  reset,  reported  a  Return-to-Normal  to  the  MPS 
simulator;  and  the  reset  initialized  the  date/time  register 
properly. 

4.4.7.13.1  Description. 

Verification  was  achieved  by  having  the  DLP,  WARP,  MPS,  and  AWOS 
#1  simulators  return  errors  during  the  first  two  mission  cycles. 
MPS  and  AWOS  #2  made  erroneous  requests  during  the  first  two 
mission  cycles.  The  test  operator  disabled  several  datapoints 
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alarms/alerts  and  changed  their  thresholds  to  values  that  were 
less  than  the  number  of  errors  induced  for  the  respective 
datapoint.  Three  of  the  disabled  datapoints  were  enabled. _  The 
datapoints  were  reset,  some  individually,  the  rest  collectively. 
The  past/present  value  and  date/time  registers  were  checked  for 
proper  recording  of  the  data. 

4.4.7.13.2  Data  Reduction  and  Analysis  Method. 

Test  OP-15 ' s  relevant  OT&E  formal  test  run  data  has  been 
incorporated  into  its  TCF  and  marked  with  the  evaluation  criteria 
cross-ref erence  numbers.  The  evaluation  criteria,  modified  to 
past-tense,  and  the  cross-ref erenced  test  data  from  OP-15' s  TCF 
are  included  below  in  this  report.  See  appendix  C  paragraph  for 
test  OP-15  for  the  completed  TCF  procedure  steps. 

For  this  test,  six  out  of  six  Evaluation  Criteria  passed.  The 
Evaluation  Criteria  used  to  determine  that  this  test's 
requirements  were  verified  are  contained  in  appendix  C. 

4.4.7.13.3  Results  and  Discussion. 

The  following  paragraphs:  contain  cross-reference  formal  test . 
data;  provide  details  of  significant  problems  encountered  during 
test  execution;  and  list  the  status  of  OT&E  PTRs  generated  with 
respect  to  test  OP-15. 

4.4.7.13.3.1  Data. 

Due  to  the  volume  of  the  cross-referenced  test  data,  it  has  not 
been  included  in  this  paragraph.  The  data  has  been  included  in 
the  appendix  C,  'OP-15'  section. 

4.4.7.13.3.2  Significant  Problems. 

None 

4.4.7.13.3.3  PTRs  Generated. 

None 

4.4.7.14  Test  OP-16. 

The  objective  of  ADAS/ALDARS  Regression  Test  OP-16  was  to  verify 
ADAS  functionality  was  not  adversely  impacted  by  the  ALDARS 
contract  modifications  to  the  previously  baselined  version  of  the 
ADAS  software.  This  functionality  test  verified  that  ADAS 
performed  checkpoint  processing,  for  support  of  recovery  of 
mission  data,  up  to  the  point  of  the  previous  completed  mission 
cycle.  This  test  verified:  the  ADAS  Event  log  indicates  the 
completion  of  mission  cycle  phases  (mission,  completion  archival, 
completion  maintenance,  completion  checkpoint,  and  idle) ;  and 
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METAR  reports  sent  to  the  WMSCR  simulator  indicate  data  only  from 
completed  cycles. 

4.4.7.14.1  Description. 

Verification,  was  achieved  by  removing  the  ADAS  checkpoint  data 
and  starting  ADAS.  The  AWOS  simulators  alternately  responded 
with  messages  indicating  rain  had  started  or  stopped.  The  Test 
Operator  logged  on  to  the  AUC  and  initiate  the  command  to  kill 
the  ADAS  Control  process.  The  CTS  simulator  waited  2  minutes, 
then  shifted  the  time  ahead  to  57  minutes  after  the  hour.  An 
AWOS  simulator  waited  for  a  flag  from  the  WMSCR  simulator 
indicating  that  it  had  received  the  hourly  METAR  report.  The 
AWOS  simulator  then  waited  until  1  second  after  the  second  ADAS 
poll  before  prompting  the  test  operator  to  trigger  the  killing  of 
the  ADAS  Control  process.  This  kill  procedure  was  repeated 
twice,  waiting  5  and  10  seconds  after  the  poll  before  prompting 
the  operator. 

4.4.7.14.2  Data  Reduction  ahd  Analysis  Method. 

Test  OP-16's  relevant  OT&E  formal  test  run  data  has  been 
incorporated  into  its  TCF  and  marked  with  the  evaluation  criteria 
cross-ref erence  numbers.  The  evaluation  criteria,  modified  to 
past-tense,  and  the  cross-referenced  test  data  from  OP-1 6* s' TCF 
are  included  below  in  this  report.  See  appendix  C  paragraph  for 
test  OP-16  for  the  completed  TCF  procedure  steps. 

For  this  test,  three  out  of  three  Evaluation  Criteria  passed. 

The  Evaluation  Criteria  used  to  determine  that  this  test's 
requirements  were  verified  are  contained  in  appendix  C. 

4.4.7.14.3  Results  and  Discussion. 

The  following  paragraphs:  contain  cross-reference  formal  test 
data;  provide  details  of  significant  problems  encountered  during 
test  execution;  and  list  the  status  of  OT&E  PTRs  generated  with 
respect  to  test  OP-16. 

4.4.7.14.3.1  Data . 

Due  to  the  volume  of  the  cross-referenced  test  data,  it  has  not 
been  included  in  this  paragraph.  The  data  has  been  included  in 
the  appendix  C,  ’OP-16'  section. 

4.4.7.14.3.2  Significant  Problems. 

None 

4.4.7.14.3.3  PTRs  Generated. 

None 
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4.4.7.15  Test  OP-17. 

The  objective  of  ADAS/ALDARS  Regression  Test  OP-17  was  to  verify 
ADAS  functionality  was  not  adversely  impacted  by  the  ALDARS 
contract  modifications  to  the  previously  baselined  version  of  the 
ADAS  software.  This  functionality  test  verified  the  ASC  display 
responds  within  the  required  time  limits. 

4.4.7.15.1  Description . 

Verification  was  achieved  by  requesting  thirty  screens  of  data, 
using  a  stopwatch  to  measure  the  response  time. 

4.4.7.15.2  Data  Reduction  and  Analysis  Method. 

Test  OP-17' s  relevant  OT&E  formal  test  run  data  has  been 
incorporated  into  its  TCF  and  marked  with  the  evaluation _ criteria 
cross-ref erence  numbers.  The  evaluation  criteria,  modified  to 
past-tense,  and  the  cross-referenced  test  data  from  OP-17' s  TCF 
are  included  below  in  this  report.  See  appendix  C  paragraph  for 
test  OP-17  for  the  completed  TCF  procedure  steps. 

For  this  test,  six  out  of  six  Evaluation  Criteria  passed.  The 
Evaluation  Criteria  used  to  determine  that  this  test's 
requirements  were  verified  are  contained  in  appendix  C. 

4.4.7.15.3  Results  and  Discussion. 

The  following  paragraphs:  contain  cross-reference  formal  test, 
data;  provide  details  of  significant  problems  encountered  during 
test  execution;  and  list  the  status  of  OT&E  PTRs  generated  with 
respect  to  test  OP-17. 

4.4.7.15.3.1  Data . 


Step : 

#9 

#10 

#11 

#12 

#13 

#14 

PASS  1 

.73 

.73 

.81 

.44 

.53 

2.07 

PASS  2 

.64 

.63 

.62 

.45 

.73 

1.82 

PASS  3 

.57 

.66 

.39 

.  63 

.  97 

1.94 

PASS  4 

.48 

.57 

.56 

.51 

.77 

1.72 

PASS  5 

.40 

.57 

.57 

.57 

.73 

1.97 

TOTALS 

2.82 

3.16 

2.95 

2.60 

3.73 

9.52 

24.78  -  2.07  =>  22.71 


/30  = 
/29  = 


.826 

.783 


4.4.7.15.3.2  Significant  Problems. 
None 

4.4.7.15.3.3  PTRs  Generated. 


None 


4.4.7.16  Test  OP-18. 


The  objective  of  ADAS / ALDARS  Regression  Test  OP-18  was  to  verify 
ADAS  functionality  was  not  adversely  impacted  by  the  ALDARS 
contract  modifications  to  the  previously  baselined  version  of  the 
ADAS  software.  This  functionality  test  verified  ASC  intrusive 
updates  occur  after  completion  of  the  mission  phase  of  the 
mission  cycle. 

4.4.7.16.1  Description. 

Verification  was  achieved  by  timing  the  response  time  of  an 
Update  Control  Adaptation  Parameter  Requests  from  every  5-second 
mark  within  the  mission  cycle. 

4.4.7.16.2  Data  Reduction  and  Analysis  Method. 

Test  OP-18' s  relevant  OT&E  formal  test  run  data  has  been 
incorporated  into  its  TCF  and  marked  with  the  evaluation  criteria 
cross-reference  numbers.  The  evaluation  criteria,  modified  to 
past-tense,  and  the  cross-referenced  test  data  from  OP-18 's  TCF 
are  included  below  in  this  report.  See  appendix  C  paragraph  for 
test  OP-18  for  the  completed  TCF  procedure  steps. 

For  this  test,  seven  out  of  seven  Evaluation  Criteria  passed. 

The  Evaluation  Criteria  used  to  determine  that  this  test's 
requirements  were  verified  are  contained  in  appendix  C. 

4.4.7.16.3  Results  and  Discussion . 

The  following  paragraphs contain  cross-reference  formal  test 
data;  provide  details  of  significant  problems  encountered  during 
test  execution;  and  list  the  status  of  OT&E  PTRs  generated  with 
respect  to  test  OP-18. 

4.4.7.16.3.1  Data . 

##THIS  PROCEDURE  WAS  REDESIGNED  DURING  FORMAL  OT&E 
TESTING! ## 

It  has  been  shown  that  this  test  is  flawed  in  its  current  form, 
in  that  the  point  in  the  mission  cycle  when  commands  are  entered 
determines  the  response  time.  As  the  test  operator  becomes  more 
efficient,  the  response  times  tend  to  increase,  eventually 
causing  the  test  to  fail.  Analysis  shows  that  Intrusive  Updates 
are  processed  only  during  the  checkpoint  phase  of  the  mission 
cycle  (nominally  15-40  seconds  into  the  mission  cycle) ,  thereby 
given  the  operator  arbitrary  control  over  the  test  outcome.  This 
procedure  will  no  longer  test  the  response  time,  but  instead  now 
demonstrates  the  response  time  from  each  5-second  mark  within  the 
mission  cycle  to  show  that  the  intrusive  updates  are  only  done 
after  the  mission  phase,  but  prior  to  the  idle  phase,  of  the 
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mission  cycle.  The  following  data  was  collected  during  this 
test’s  OT&E  Formal  Test  Run: 


5-Second 

Mark 

0 

5 

10  15 

20 

25 

Response 

Time 

17.52 

13.40 

11.24  3.15 

0.83 

0.73 

5-Second 

Mark 

30 

35 

40  45 

50 

55 

Response 

23.38 

Time 

0.8 

0.64 

0.67 

33.53  30.88 

This  TCF  will 

be  updated 

to  reflect 

the 

redesign  prior  to 

incorporation 

into 

the  Post-ALDARS 

OT&E 

ADAS  Regression  Test 

Procedures . 

4.4.7.16.3.2 

Significant 

Problems . 

None 


4.4.7.16.3.3  PTRs  Generated. 

None 

4.4.8  Category  PT  -  ADAS  Mods  PTRs  and  Site  Issues. 

4. 4. 8.1  ADAS/ALDARS  PT  Test  IDs. 

This  section  references  the  procedures  that  address  the  ADAS 
Modifications  Contract  (ADAS/Mods)  PTRs  and  Site  Incident  Reports 
(SIRs)  included  in  the  ADAS/ALDARS  Contract  SOW  and  Contract 
Modifications.  The  ADAS/Mods  PTRs  were  generated  at  the  ADAS  PSF 
at  the  FAA  Technical  Center  at  the  Atlantic  City  International 
Airport.  The  ADAS/Mods  SIRs  were  generated  at  the  Boston  ARTCC 
in  Nashua,  NH.  The  ADAS/Mods  PTRs  and  SIRs  were  assigned 
ADAS/ALDARS  OT&E  test  IDs  PT-01  through  PT-15.  The  following 
paragraphs  describe  each  of  the  nine  PTRs  and  six  SIRs,  analysis 
of  relevant  data,  and  ACT-320 's  recommended  disposition  of  each 
issue . 

4. 4. 8. 1.1  PT-01  -  M-0028  -  Wind  Speed  Encoding  Error. 

PROBLEM:  Test  Cl  attempted-  to  test  the  wind  speed  encoding 

in  an  SP  SAO.  First,  a  20-knot  wind  speed  was  to 
be  reported,  and  then  a  105-knot  wind  speed  was  to 
be  reported.  The  20-knot  wind  speed  was  correctly 
reported,  but  the  105-knot  wind  speed  was  not. 

ADAS  should  add  50  to  the  direction  for  speeds 
over  99-knots.  ADAS  incorrectly  encoded 
" 0550G12 . "  ADAS  should  have  encoded  "5505G12." 

SOLUTION:  New  Metar  encoding  algorithm. 
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VERIFICATION:  The  ADAS/ALDARS  OT&E  formal  test  run  of  D20-27 

provided  the  data  required  for  analysis. 

DR&A  RESULTS:  The  analysis  of  D20-27  formal  test  run  data 

indicates  the  wind  speed  is  encoded  in  accordance 
with  the  ADAS/AWOS  ICD  appendix  IX  -  Aviation 
Routine  Weather  Report  (METAR)  Format  Weather 
Messages . 

OT&E  RECOMMENDATION:  PTR  CLOSED  -  Described  problem  no  longer 

exists . 

4. 4. 8. 1.2  PT-02  -  PTR-77  -  Cycle  Overrun  and  Related  Issues. 

Two  consecutive  mission  cycle  overruns  cause  the 
ADAS  application  to  shut  down  and  auto-restart. 

DME  proposed  that  incrementing  the  mission  cycle 
overrun  counter  from  2  to  4  should  alleviate  the 
problem.  DT&E  and  OT&E  testing  could  not  recreate 
this  problem,  this  PTR  is  considered  closed.. 

The  ADAS/ALDARS  OT&E  formal  test  run  of  D75-01 
provided  the  data  required  for  analysis.' 

The  analysis  of  D75-01  formal  test  run  data 
indicates  ADAS  does  not  shut  down  and  restart 
after  three  consecutive  mission  cycles  are 
overrun. 

OT&E  RECOMMENDATION:  PTR  CLOSED  -  Described  problem  no  longer 

exists. 

4. 4. 8. 1.3  PT-03  -  M-0029  -  3-Hour  Pressure  Tendency  Not  Encoded . 


PROBLEM: 

SOLUTION: 

VERIFICATION: 

DR&A  RESULTS: 


PROBLEM: 

SOLUTION: 


ADAS  fails  to  encode  the  3-Hour  pressure  tendency 
if  a  6-Hour  precipitation  is  encoded. 

New  METAR  encoding  algorithm. 


VERIFICATION:  The  ADAS/ALDARS  OT&E  formal  test  run  of  D20-79 

provided  the  data  required  for  analysis. 

DR&A  RESULTS:  The  analysis  of  D20-79  OT&E  formal  test  run  data 

indicates  the  3-Hour  pressure  tendency  is  encoded 
in  accordance  with  the  ADAS/AWOS  ICD  appendix  IX  - 
Aviation  Routine  Weather  Report  (METAR)  Format 
Weather  Messages. 


OT&E  RECOMMENDATION:  PTR  CLOSED  -  Described  problem  no  longer 

exists. 
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4. 4. 8. 1.4  PT-04  -  M-0031  -  Site  ID  Mismatch  Error . 

PROBLEM:  The  final  analysis  of  this  problem  revealed  the 

ADAS  testbed  utility  for  generating  adaptation 
database  failed  to  pad  AWOS  site  IDs  with  spaces 
when  the  IDs  were  less  than  four  characters  in 
length.  The  ADAS  extracted  four  character  site 
IDs  from  incoming  messages  to  compare  to  the 
expected  site  IDs  from  the  ADB.  Erroneously 
comparing  strings  of  unequal  length  is  an  invalid 
operation  not  anticipated  by  ADAS,  whose  design 
inherently  expects  all  site  IDs  to  be  four 
characters  long. 

SOLUTION:  The  ADAS  application  and  utilities  no  longer 

generate  a  site  ID  less  than  four  characters  in 
length. 

VERIFICATION:  ADAS/ALDARS  OT&E  formal  test  run  of  ST-02  provided 

the  data  required  for  analysis. 

DR&A  RESULTS:  The  ADAS  application  program  and  utilities  prevent 

the  condition  which  enabled  the  error  to  occur. 

OT&E  RECOMMENDATION:  PTR  CLOSED  -  Described  problem  no ' longer 

exists . 

4. 4. 8. 1.5  PT-05  -  M-0035  -  0  &  100  Degree  Temp.  Encoding  Error. 

PROBLEM:  During  the  29th  hour  of  test  D3  (now  ME-14)  at 

0000  (0  hundred  hours)  ADAS  reported  the  max  temp 
for  the  last  12  hours  and  min  temp  for  the  last  18 
hours.  The  values  to  be  encoded  were  0  deg  max 
and  -40  deg  min  and  should  have  been  encoded  as 
’40060',  but  ADAS  encoded  '410060'.  NOTE  1:  100 
is  added  to  temps  below  0  or  subtracted  from  temps 
over  99.  So  encoded  temps  are  always  2  bytes  (2 
digits,  no  sign) .  NOTE  2:  Format  is  4TxTxTnTn, 
where  Tx  is  max  temp  and  Tn  is  min  temp.  Further 
tests  revealed  that  the  error  occurs  at  both  0  and 
100  degrees.  i.e.  When  the  simulator  was  set  to 
either  0  or  100  degrees  the  result  was  encoded  as 
100.  This  is  in  violation  of  the  format 
requirement  which  states  that  only  2  characters  be 
encoded.  This  test  was  run  as  part  of  Test  D3 . 

SOLUTION:  New  METAR  encoding  algorithm. 

DR&A  RESULTS:  The  OT&E  formal  test  run  data  from  D20-76  verified 

the  temperature  is  encoded  in  accordance  with  the 
ADAS/AWOS  ICD  appendix  IX  -  Aviation  Routine 
Weather  Report  (METAR)  Format  Weather  Messages. 
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OT&E  RECOMMENDATION:  PTR  CLOSED  -  Described  problem  no  longer 

exists . 

4. 4. 8. 1.6  PT-06  -  M-0036  -  100  Knot  Gu£t  Encoding  Error. 

PROBLEM:  It  was  observed  in  the  results  of  test  C7_line  (as 

well  as  in  the  original  test  during  DT&E,~test 
C004)  that  the  gust  of  100  knots  in  the  AWOS  Std 
message  is  not  encode  properly.  The  SAO  generated 
message  contained  "GOO"  and  it  should  have  been 
"  G 1 0  0  "  . 

SOLUTION:  New  METAR  encoding  algorithm. 

VERIFICATION:  The  ADAS/ALDARS  OT&E  formal  test  run  of  D20-27 

provided  the  data  required  for  analysis. 

DR&A  RESULTS:  The  OT&E  formal  test  run  data  verifies  proper 

encodes  wind  gust  is  encoded  in  accordance  with 
the  ADAS/AWOS  ICD  appendix  IX  -  Aviation  Routine 
Weather  Report  (METAR)  Format  Weather  Messages. 

OT&E  RECOMMENDATION:  PTR  CLOSED  -  Described  problem  no  longer 

exists. 

4. 4. 8. 1.7  PT-07  -  M-0040  -  SAO  Visibility  Encoding  Error. 

An  IPS  Test  Sequence,  Test  D3_PTR  (now  ME-14), 
provided  messages  to  ADAS  where  the  2  and  3  mile 
visibility  thresholds  were  crossed  (ie.  1.75  -> 
2.25,  2.75  ->  3.25,  3.25  ->  2.75).  The  expected 
SP's  were  generated  by  ADAS  at  the  correct  time, 
but  the  visibility  value  in  the  SAO  message  was 
"M"  (meaning  Missing) ,  not  the  appropriate 
numerical  value.  This  PTR  was  first  discovered 
during  previous  OT&E  at  which  time  it  was  called 
PTR  OTE-065.  It  seems,  after  some  investigating, 
that  CPE  never  received  this  PTR.  ACW  checked  PTR 
documentation  sent  by  CPE  and  found  that  they  had 
incorrectly  identified  PTR  OTE-065.  As  a  result 
the  problem  described  above  was  not  corrected. 

PTR  OTE-065  has  been  closed  and  this  PTR,  M-0040, 
has  been  opened. 

New  METAR  format  encoding  algorithm. 

VERIFICATION:  ADAS/ALDARS  OT&E  formal  test  run  of  D20-30 

provided  the  data  required  for  analysis. 

DR&A  RESULTS:  The  OT&E  formal  test  run  data  verified  the  Metar 

Visibility  Field  is  encoded  in  accordance  with  the 


PROBLEM: 


SOLUTION: 
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ADAS/AWOS  ICD  appendix  IX  -  Aviation  Routine 
Weather  Report  (METAR)  Format  Weather  Messages. 

OT&E  RECOMMENDATION:  PTR  CLOSED  -  Described  problem  no  longer 

exists . 

4. 4. 8. 1.8  PT-08  -  M- 0042  -  Other  Remarks,  Present  Weather 

Section  Not  Indicated. 

PROBLEM:  In  C16_OBS,  simulator  #4  generated  conditions  of 

drizzle  and  undetermined  precipitation.  They  were 
correctly  reported  in  the  Present  Weather  field  of 
the  SAO  message,  but  in  the  OTHER  REMARKS,  PRESENT 
WEATHER  section  the  end  of  drizzle  (LExx)  and 
beginning  of  undetermined  precipitation  (PBxx)  was 
not  indicated.  LBxx  and  PExx  were  correctly 
reported.  Similar  problems  also  occurred  for 
simulators  #2  and  #3  regarding  ZLExx.  ZLBxx  was 
reported  but  never  ZLExx,  despite  the  fact  that  ZL 
(in  the  Present  Weather  field)  began  and  ended. 
09/28/95  -  While  regression  tests  were  being 
updated  and  organized  additional  information  for 
this  PTR  was  acquired.  Test  5301-1  was  run  and  it 
was  discovered  that  for  the  OTHER  REMARKS,  PRESENT 
WEATHER  section  there  were  10  additional  types 
that  were  not  being  reported  correctly  (TE,  RE, 

ZRE,  ZLB,  IPB,  IPE,  SB,  SE,  AB,  and  AE) . 

SOLUTION:  New  METAR  encoding  algorithm. 

VERIFICATION:  The  ADAS/ ALDARS  OT&E  formal  test  run  of  D20-61 

provided  the  data  required  for  analysis. 

DR&A  RESULTS:  The  QT&E  formal  test  run  data  verified  the  Metar 

visibility  field  is  encoded  in  accordance  with  the 
ADAS/AWOS  ICD  appendix  IX  -  Aviation  Routine 
Weather  Report  (METAR)  Format  Weather  Messages. 

OT&E  RECOMMENDATION:  PTR  CLOSED  Described  problem  no  longer 

exists. 

4. 4. 8. 1.9  PT-09  -  M-0043  -  Dewpoint  Temperature  ICD  Violation. 

PROBLEM:  The  ADAS  encodes  the  dewpoint  sensor  as  missing 

when  the  ambient  temperature  sensor  is  reported  as 
missing. 

SOLUTION:  This  PTR  is  closed  due  to  an  update  of  the 

ADAS/AWOS  ICD.  The  ICD  was  changed  to  reflect  the 
behavior  exhibited  by  ADAS. 

VERIFICATION:  The  ADAS/ALDARS  OT&E  formal  test  run  of  D20-42 


VERIFICATION:  The  ADAS/ALDARS  OT&E  formal  test  run  of  D20-42 

provided  the  data  required  for  analysis. 

DR&A  RESULTS:  The  OT&E  formal  test  run  data  verified  the  dew 

point  temperature  is  encoded  in  accordance  with 
the  ADAS/AWOS  ICD  appendix  IX  -  Aviation  Routine 
Weather  Report  (METAR)  Format  Weather  Messages. 

OT&E  RECOMMENDATION:  PTR  CLOSED  -  Described  problem  no  longer 

exists. 

4.4.8.1.10  PT-10  -  SI-01  -  Configured  Sites  Report  "CFG-NOT". 

PROBLEM:  The  Specialist  Interface  AWOS  STATION  LU  DATAPOINT 

screen  (figure  3-68  of  the  Software  User  Manual 
(SUM) )  displays  a  CONNECTION  STATUS  data  point 
value  of  "CFG-NOT"  for  the  Fitchburg  ASOS  site, 
FIT.  However,  this  site  was  configured  properly, 
communications  was  established,  and  both  AWOS 
Format  Weather  Messages  and  SAO  messages  were 
received  from  Fitchburg.  Moreover,  during 
successful  communications  transmission  with 
Fitchburg,  all  other  datapoints  associated  with 
the  AWOS  STATION  LU  DATAPOINT  screen,  such  as 
FRAMES  TRANSMITTED  and  FRAMES  DELIVERED,  were  not 
updated;  this  additional  problem  may  however  prove 
to  be  a  natural  consequence  of  the  maintenance 
processor's  mistaken  belief  that  the  station  is 
not  configured.  The  anomaly  is  reported  as 
critical  because  reporting  the  correct  connection 
and  communication  data  point  values  of  the  AWOS 
stations  assists  immeasurably  in  debugging  the 
AWOS  and  ASOS  communication  paths.  It  is 
worthwhile  to  note  that  when  the  ADAS  tape 
arrived,  a  dummy  AWOS  station,  called  "R001",  was 
configured  on  Channel  1  of  Controller  1.  This 
AWOS  site  displays  the  correct  connection  status 
data  point  value  of  "CFG-FAILED"  for  an  invalid 
AWOS  site.  When  the  ADAS  polling  message  output 
is  looped  back  via  the  LSI  modem  to  the  input  of 
Channel  1  of  Controller  1  and  the  R001  station  is 
placed  "IN-SERVICE",  the  LINK  RESET  COUNT  and  LINK 
DISCONN  COUNT  data  point  values  are  incremented  as 
expected.  Additional  live  testing  and  checking  of 
the  ADAS  source  will  be  necessary  to  suggest  an 
alternative  or  even  to  eliminate  operator  error. 

SOLUTION:  DME ' s  evaluation  revealed  a  cross-reference 

discrepancy  between  the  MP  and  CHD  software 
modules . 
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VERIFICATION:  The  ADAS/ALDARS  OT&E  formal  test  run  of  IN-12D 

provided  the  data  required  for  analysis. 

DR&A  RESULTS:  The  OT&E  formal  test  run  data  verified  the 

correction  of  the  problem. 

OT&E  RECOMMENDATION:  CLOSE  Site  Issue  -  Described  problem  no 

longer  exists. 

4.4.8.1.11  PT-11  -  SI-02  -  Only  AWOS  Station  1  in  RMS  Master  Can 

Be  Edited. 

PROBLEM:  Paragraph  3.4.2.2.16.3  of  the  ADAS  Software  User's 

Manual  describes  the  process  of  editing  the  RMS 
Mas ter /AWOS  Stations  Datapoint  Thresholds.  When 
this  process  was  tried  for  the  AWOS  and  ASOS 
stations  that  were  configured  for  Boston,  the 
software  only  allowed  changes  to  AWOS  STATION  1. 
For  AWOS  STATION  2  through  137,  the  following 
message  was  displayed:  >>  DATAPOINT  DOES  NOT  HAVE 
THRESHOLDS!  ENTER  -1  FOR  UNDEFINED.  Any  attempt 
to  edit  these  thresholds  was  met  with  the  INVALID 
ENTRY!  message.  As  of  this  writing,  there  is 
reason  to  believe  that  CommPower  deliberately  made 
the  software  work  this  way,  i.e.  that  only  one  set 
of  thresholds  should  be  defined  for  all  137  of 
these  AWOS  datapoints;  the  ADAS  source  code  should 
be  investigated  further. 

SOLUTION:  The  site  issue  describes  functionality  inherent  to 

the  current  system  design.  Changing  this 
functionality  will  require  a  change  to  the  ADAS 
System  Specification  (FAA-E-2804 ) . 

VERIFICATION:  The  ADAS/ALDARS  OT&E  formal  test  run  of  IN-12D 

provided  the  data  required  for  analysis. 

DR&A  RESULTS:  The  following  SI  screen  print  captures  demonstrate 

that  only  the  1st  AWOS  Station's  Datapoint 
Thresholds  can  be  edited.  This  is  inherent  to  the 
application's  design,  not  a  symptom  of  a  problem. 
All  AWOS/ASOS  Stations  use  the  Thresholds  of  the 
first  AWOS  Station. 


.  11-12-97  00:02:53  .  Events:  9  .  Responses:  0  .  ADAPTATION  CMOS 

. SI) IT  RMS  MASTER/ STATIONS  LU  DATAPOINT  THRESHOLDS 

SITE  DP  ALERT  ALARM 

DATAPOINT  NAME  ID  ID  VALUE  CURR  PAST  CURR  PAST  LAST  RESET 

AWOS  STATION  1:  KOI  12  NORMAL  11-11-97  23:31:17 

AWOS  STATION  2:  K002  13  NORMAL  11-11-97  23:31:17 

AWOS  STATION  3:  K003  14  NORMAL  11-11-97  23:31:17 

AWOS  STATION  4:  K004  15  NORMAL  11-11-97  23:31:17 

AWOS  STATION  5:  K005  16  NORMAL  11-11-97  23:31:17 

ALERT  THRESHOLDS  ALARM  THRESHOLDS 

UPPER  LOWER  ENAB  UPPER  LOWER  ENAB 

5  4  YES  3  2  YES 

>  ENTER  LOWER  THRESHOLD  (0  TO  65535)  ,  -1  FOR  UNDEFINED 
PRESS  ARROW  KEYS  TO  POSITION;  PRESS  RETURN  KEY  ON  LAST  FIELD  TO  ESCAPE 
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.  11-12-97  00:03:02  .  Events: 


9  .  Responses : 


ADAPTATION  CMOS 


EDIT  RMS  MASTER/STATIONS  LU  DATAPOINT  THRESHOLDS 
SITE  DP  ALERT  ALARM 

DATAPOINT  NAME  ID  ID  VALUE  CURR  PAST  CURR  PAST  LAST  RESET 

AWOS  STATION  1:  KOI  12  NORMAL 
AWOS  STATION  2:  K002  13  NORMAL 
AWOS  STATION  3:  K003  14  NORMAL 

AWOS  STATION  4:  K004  15  NORMAL 

AWOS  STATION  5:  K005  16  NORMAL 

ALERT  THRESHOLDS  ALARM  THRESHOLDS 

UPPER.  LOWER  ENAB  UPPER  LOWER  ENAB 

“1  “1  YES  -1  -1  YES 

»  DATAPOINT  DOES  NOT  HAVE  THRESHOLDS!  ENTER  -1  FOR  UNDEFINED 
PRESS  ARROW  KEYS  TO  POSITION;  PRESS  RETURN  KEY  ON  LAST  FIELD  TO  ESCAPE 


11-11-97  23:31:17 
11-11-97  23:31:17 
11-11-97  23:31:17 
11-11-97  23:31:17 
11-11-97  23:31:17 


OT&E  RECOMMENDATION:  CLOSE  Site  Issue  -  It  has  been 

determined  that  this  is  by  design  and  not  an  error 
of  the  ADAS  program. 


4.4.8.1.12  PT-12  -  SI-03  -  AWOS  Station  List  Association 

Problem.  '  ~~~ 

PROBLEM:  The  ADAS  maintains  a  simple  list  of  associated 

AWOS  sites  as  a  set  of  137  records.  AWOS  sites 
are  put  into  this  list  simply  in  the  temporal 
order  in  which  they  are  entered  by  the  Specialist. 
However/  when  the  Specialist  calls  for  a  display 
or  printout  of  the  AWOS  entered  so  far,  the  ADAS 
first  sorts  its  internal  AWOS  list  by  Controller 
and  Channel  -  thus  the  actual  order  of  the 
internal  list  cannot  be  derived  from  the 
display/printout.  The  problem  arises  because,  in 
the  RMS  Maintenance  Processor,  the  RMS  Master 
Logical  Unit  maintains  137  data  points  dedicated 
to  the  status  of  each  of  the  137  AWOS  Logical 
Units  -  these  DPs  are  not  identified  other  than  as 
"AWOS  Station  1",  "AWOS  Station  2",  etc., 
therefore,  the  specialist  cannot  tell  which  actual 
site  that  Station  1,  etc.,  corresponds  to.  There 
is  no  simple  workaround  for  this  problem.  The 
ADAS  code  should  be  investigated  to  determine  the 
simplest  software  change  that  could  fix  the 
problem,  presumably  an  additional  capability  to 
list  all  AWOS  in  their  internal,  unsorted  order. 

SOLUTION:  DME  incorporated  the  site  ID  into  data  displayed 

for  each  station. 

VERIFICATION:  The  ADAS/ALDARS  OT&E  formal  test  run  of  IN-12D 

provided  the  data  required  for  analysis. 

DR&A  RESULTS:  The  Site  ID's  are  now  included  in  the  screen 

display. 

OT&E  RECOMMENDATION:  CLOSE  Site  Issue  -  Described  problem  no 

longer  exists. 
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4.4.8.1.13  PT-13  -  SI-04  -  Unattended  Mode  Triggers  Reduced 

Mode . 

PROBLEM:  Switching  the  Mode  Selection  switch  on  the  alarm 

and  control  panel  to  'UNATTENDED'  causes  ADAS  to 
report  'REDUCED'  operational  mode.  This  is  the 
operational  setting  and  ADAS  should  still  be 
reporting  an  operational  mode  of  'FULL'. 

SOLUTION:  DME  needs  to  correct  the  reduce  mode  logic 

encoding. 

VERIFICATION:  The  ADAS/ALDARS  OT&E  formal  test  run  of  OP-13 

provided  the  data  required  for  analysis. 


DR&A  RESULTS:  UNATTENDED  Mode  no  longer  induces  a  REDUCED 

Operational  Mode. 

OT&E  RECOMMENDATION:  CLOSE  Site  Issue  -  Described  problem  no 

longer  exists. 

4.4.8.1.14  PT-14  -  SI-05  -  SAP  Archive/WMSCR  3  Hour  Buffer 
Error. 

When  the  WMSCR  interface  is  down,  the  SAO  messages 
from  the  ASOS  sites  (which  should  be  sent  to  the  3 
hour  buffer)  are  also  appearing  in  the  SAO 
archive.  ASOS  generated  SAO  messages  should  not 
be  archived  by  ADAS . 

DME  needs  to  correct  the  WMSCR  buffer  code. 

The  ADAS/ALDARS  OT&E  formal  test  run  of  D50-01 
provided  the  data  required  for  analysis. 

The  OT&E  formal  test  run  data  verified  the  archive 
now  contains  only  ADAS  generated  Metar  format 
messages. 

OT&E  RECOMMENDATION:  CLOSE  Site  Issue  -  Described  problem  no 

longer  exists . 

4.4.8.1.15  PT-15  -  SI-06  -  ADAS  Fails  To  SEND  Error  ADU  To  AWOS 
Sites . 

PROBLEM:  ADAS  does  not  send  error  messages  to  ASOS  or  AWOS 

systems. 

SOLUTION:  Correction  of  the  software  code. 


PROBLEM: 

SOLUTION : 
VERIFICATION: 

DR&A  RESULTS: 
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VERIFICATION:  The  ADAS/ALDARS  OT&E  formal  test  run  of  D10-01 

provided  the  data  required  for  analysis. 

DR&A  RESULTS:  ADAS  now  sends  error  messages  to  AWOS  &  ASOS 

sites. 

OT&E  RECOMMENDATION:  CLOSE  Site  Issue  -  Described  problem  no 

longer  exists. 

4. 4. 8. 2  Significant  Problems. 

None 

4. 4. 8. 3  PTRs  Generated. 

None 

4. 4. 8. 4  Conclusions. 

All  PTRs  and  Site  Issues  included  in  the  ADAS/ALDARS  SOW  have 
been  satisfactorily  addressed. 

4. 4. 8. 5  Recommendations. 

ACT-320  has  closed  the  9  ADAS/Mods  OT&E  PTRs  included  in  the 
ADAS/ALDARS  SOW.  ACT-320  recommends  the  6  ADAS/Mods  Site  Issues 
included  in  the  ADAS/ALDARS  SOW  be  closed. 

4.4.9  Category  RA  -  Reliability  and  Availability . 

4. 4. 9.1  Test  RA-01  -  Reliability  and  Availability. 

The  objective  of  this  test  was  to  verify  particular  ALDARS  NAS- 
SS-1000  requirements  (see  appendix  A).  In  order  to  meet  this 
Objective,  this  test  used  to  evaluate  the  reliability  and 
availability  of  the  ADAS  system  with  the  new  ALDARS-associated 
software  and  hardware  installed. 

4. 4. 9. 1.1  Description. 

The  ADAS  was  configured  to  correspond  to  the  NLDN  interface. 

This  was  accomplished  by  using  the  ASC  to  access  the  ADAS 
adaptation  parameters  and  by  physical  connection  to  its 
respective  NLDN  port.  Additionally,  the  ADAS  was  configured  to 
geographically  cover  the  continental  U.S.  With  the  ADAS 
configured  in  this  way,  ADAS  received  all  LDD  Flash  Messages  from 
the  NLDN. 

4. 4. 9. 1.2  Data  Reduction  and  Analysis  Method. 

During  the  conduct  of  DT&E  at  DME's  facility,  DME  Corporation 
collected  the  Reliability  and  Availability  (RA)  data.  The  RA 
data  provided  to  the  Technical  Center  after  the  DT&E  was 
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completed.  The  RA  data  consisted  of  the  measurement  of  the 
uptime  and  the  downtime  of  the  ADAS/NLDN.  At  the  Technical 
Center,  ACT-320  collected  the  RA  data  during  the  OT&E.  The 
collected  data  at  the  Technical  Center  and  the  DME's  facility 
were  used  for  analyzing  the  RA  of  the  ADAS/ALDARS. 

The  Availability  evaluation  was  determined  by  analysis  of  uptime 
and  downtime  data.  The  Reliability  evaluation  was  measured  by 
the  Mean  Time  Between  Failure  (MTBF) .  The  analysis  was  based  on 
a  comparison  between  the  RA  data  from  DME  and  the  RA  data  from 
the  Technical  Center.  The  comparison  considered  the  uptime  and 
the  downtime  of  the  system  during  the  conduct  of  test.  The  MTBF 
was  determined  by  using  the  uptime  and  the  downtime  of  the 
system. 

For  this  test,  three  out  of  three  Evaluation  Criteria  passed. 

The  Evaluation  Criteria  used  to  determine  that  this  test's 
requirements  were  verified  are  contained  in  appendix  C. 

4. 4. 9. 1.3  Results  and  Discussion. 

4 . 4 . 9 . 1 . 3 . 1  Data . 

MTBF  =  total  number  of  measured  hours/#  of  failures 
MTTR  =  total  #  amount  of  downtime/#  of  failures 
Availability  =  MTBF/ (MTBF+MTTR) 

The  total  of  test  time  =  95  days  =  2280  hours 
The  total  of  down  time  =  0  hour 
MTTR  =  0  hour 

Reliability  =  MTBF  =  2280  hours  >  2190  hours 

Availability  =  MTBF/ (MTBF+MTTR)  =  2280/(2280  +  0)  =  1  >  0.99973 

4. 4. 9. 1.3. 2  Significant  Problems . 

Regression  testing  of  OT&E  #1  PTRs: 

PTR  OTE-001  was  closed.  OT&E  #2  Regression  testing  of  PTR  OTE- 
001  demonstrated  the  buffer  box  problem  was  fixed. 

4. 4. 9. 1.3. 3  PTRs  Generated. 

See  appendix  B  for  complete  PTR  details.  The  PTRs  generated  with 
respect  to  this  test  are: 

Critical  PTR(s):  OTE-001  -  CLOSED. 

4.4.10  Category  ST  -  Stress  Tests. 

4.4.10.1  Test  ST-01. 

The  objective  of  ADAS/ALDARS  Regression  Test  ST-01  was  to  verify 
ADAS  functionality  was  not  adversely  impacted  by  the  ALDARS 
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contract  modifications  to  the  previously  baselined  version  of  the 
ADAS  software.  This  functionality  test  stress  tested  ADAS  under 
nominal  conditions,  using  the  defined  maximum  number  of  external 
interfaces  and  the  defined  maximum  number  of  lightning  strikes. 

4.4.10.1.1  Description. 

This  procedure  verified  proper  processing  of  AWOS  type  messages, 
within  each  mission  cycle,  from  25  AWOS  and  50  ASOS  stations,  to 
eight  recipient  NADIN  users  (DLP,  six  ITWSs,  and  WARP) .  The  test 
configuration  used  10  AWOS  and  10  ASOS-type  AWOS  simulators  to 
return  AWOS  messages  containing  automated  remarks,  and  an 
additional  10  of  each  type  station  to  return  AWOS  messages  with 
operator  remarks.  The  remainder  of  the  AWOS  and  ASOS  type  AWOS 
stations  returned  standard  AWOS  messages. 

4.4.10.1.2  Data  Reduction  and  Analysis  Method. 

Test  ST-01’ s  relevant  OT&E  formal  test  run  data  has  been 
incorporated  into  its  TCF  and  marked  with  the  evaluation  criteria 
cross-reference  numbers.  The  evaluation  criteria,  modified  to 
past-tense,  and  the  cross-referenced  test  data  from  ST-01 's  TCF 
are  included  below  in  this  report.  See  appendix  C  paragraph  for 
test  ST-01  for  the  completed  TCF  procedure  steps. 

For  this  test,  six  out  of  six  Evaluation  Criteria  passed.  The 
Evaluation  Criteria  used  to  determine  that  this  test’s 
requirements  were  verified  are  contained  in  appendix  C. 

4.4.10.1.3  Results  and  Discussion . 

The  following  paragraphs:  contain  cross-reference  formal  test 
data;  provide  details  of  significant  problems  encountered  during 
test  execution;  and  list  the  status  of  OT&E  PTRs  generated  with 
respect  to  test  ST-01 . 

4.4.10.1.3.1  Data . 

Due  to  the  volume  of  the  cross-referenced  test  data,  it  has  not 
been  included  in  this  paragraph.  The  data  has  been  included  in 
appendix  C. 

4.4.10.1.3.2  Significant  Problems. 

This  test  originally  used  the  individual  maximum  for  each 
external  interface.  ADAS  was  able  to  complete  the  mission  phase 
of  its  mission  cycle  when  configured  with  137  AWOS/ASOS  stations, 
6  ITWSs,  and  1  of  each  other  interface.  All  stations  are  polled, 
the  weather  data  is  processed,  and  appropriate  messages  are 
queued  for  output  within  the  26.2  seconds  specified  by 
requirement.  The  fails  to  transmit  the  data  queued  before  the 
end  of  the  1-minute  mission  cycle,  triggering  a  "FAILURE  TO 
COMPLETE  MISSION  CYCLE  IN  60  SECONDS"  event.  Analysis  showed  the 
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NADIN  has  sufficient  bandwidth  to  transfer  the  data  within  the 
mission  cycle.  This  isolated  the  problem  to  the  test's  design 
exceeding  the  IPS  resources  to  simulate  individual  maximum  for 
each  external  interface. 

To  address  this  problem,  the  ADAS  Program  Office  defined  the 
maximum  configuration  of  external  interfaces  for  an  ADAS 
operationally  integrated  into  the  NAS.  The  stress  tests  were 
redesigned  to  limit  the  test  configuration  to  an  operational 
maximum  interface  configuration  of  6  ITWSs,  25  AWOSs,  50  ASOSs, 
and  one  each  of  the  remaining  external  interfaces  (CTS,  DLP,  MPS, 
NLDN,  WARP,  and  WMSCR) ,  with  the  NLDN  providing  1100  strikes  per 
minute,  700  of  which  are  within  the  ADAS's  operational  boundary. 
The  reconfigured  tests  completed  successfully  with  no  mission 
cycle  overruns. 

4.4.10.1.3.3  PTRs  Generated. 

None 

4.4.10.2  Test  ST-02. 

The  objective  of  ADAS/ALDARS  Regression  Test  ST-02  was  to  verify 
ADAS  functionality  was  not  adversely  impacted  by  the  ALDARS 
contract  modifications  to  the  previously  baselined  version  of  the 
ADAS  software.  This  functionality  test  builds  on  ST-01  -  All 
Stations  Nominal  by  having  the  ASOS  stations  send  METAR  messages, 
and  the  AWOS  stations  trigger  METAR  Generation  Processing,  to 
increase  ADAS's  processing  load.  This  test  procedure  also 
provided  the  data  for  verification  of  ADAS / ALDARS  OT&E  TVRTM 
requirements  MSS2-030  through  MSS2-033,  listed  in  appendix  A, 
table  10.2-3. 

4.4.10.2.1  Description . 

This  procedure  verified  proper  processing  of  AWOS  and  METAR 
messages  from  75  stations.  This  was  achieved  by  having  the  AWOS 
25  simulators  return  AWOS  messages  which  will  trigger  SPECIs,  and 
all  of  the  ASOS  type  AWOS  simulators  return  both  a  AWOS  format 
message  and  a  METAR  format  message. 

4.4.10.2.2  Data  Reduction  and  Analysis  Method. 

Test  ST-02' s  relevant  OT&E  formal  test  run  data  has  been 
incorporated  into  its  TCF  and  marked  with  the  evaluation  criteria 
cross-reference  numbers.  The  evaluation  criteria,  modified  to 
past-tense,  and  the  cross-referenced  test  data  from  ST-02' s  TCF 
are  included  below  in  this  report.  See  appendix  C  paragraph  for 
test  ST-02  for  the  completed  TCF  procedure  steps. 

For  this  test,  six  out  of  six  Evaluation  Criteria  passed.  The 
Evaluation  Criteria  used  to  determine  that  this  test's 
requirements  were  verified  are  contained  in  appendix  C. 
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4.4.10.2.3  Results  and  Discussion . 

The  following  paragraphs:  contain  cross-reference  formal  test 
data;  provide  details  of  significant  problems  encountered  during 
test  execution;  and  list  the  status  of  OT&E  PTRs  generated  with 
respect  to  test  ST-02. 

4.4.10.2.3.1  Data. 

Due  to  the  volume  of  the  cross-referenced  test  data,  it  has  not 
been  included  in  this  paragraph.  The  data  has  been  included  in 
appendix  C. 

4.4.10.2.3.2  Significant  Problems. 

See  ST-01  significant  problems  detailed  in  paragraph  4.4.10.1.3.2 
of  this  report. 

4.4.10.2.3.3  PTRs  Generated. 

None 

4.4.11  Category  ADD  -  Additional  Tests. 

During  OT&E  there  were  some  tests  and  analysis  performed  that 
were  not  originally  planned  and  for  which  no  formal  test 
procedures  were  developed.  However,  these  ad  hoc  tests  generated 
significant  results  and,  therefore,  have  been  included  in  the 
OT&E  Final  Report. 

4.4.11.1  Analysis  of  OTIS  METAR  Data. 

4.4.11.1.1  Description . 

In  response  to  a  request  from  the  ADAS  Program  Office,  when  the 
ADAS  testbed  was  not  being  used  for  ADAS  OT&E,  the  ADAS  was  often 
connected  to  the  OTIS  AWOS  site  to  capture  the  METAR  messages 
ADAS  would  generate  for  delivery  to  WMSCR.  This  captured  data 
was  sent  to  the  ADAS  Program  Office  for  analysis. 

4.4.11.1.2  Data  Reduction  and  Analysis  Method. 

During  periods  when  the  ADAS  testbed  was  not  being  used  for 
formal  tests,  a  configuration  was  loaded  to  collect  data  from  the 
OTIS  AWOS.  The  IPS  WMSCR  data  (METARs  and  SPECIs)  were 
downloaded  to  PC  as  an  ASCII  file  and  then  sent  to  AUA-430. 
AUA-430  utilized  Engineers  and  Meteorologists  familiar  with  the 
METAR  format  to  analyze  these  data  in  order  to  determine  if  ADAS 
was  generating  these  messages  correctly.  Any  anomalies  were 
reported  to  ACT-320  and  a  PTR  was  generated. 


126 


4.4.11.1.3  Results  and  Discussion . 

The  following  paragraphs:  provide  details  of  significant  problems 
encountered  during  this  analysis  and  list  the  status  of  OT&E  PTRs 
generated  with  respect  to  this  analysis. 

4.4.11.1.3.1  Significant  Problems. 

a.  The  xxxNO  REMARKS  were  included  in  ADAS  generated  METAR 
messages  but  were  missing  from  the  SPECIs.  The  resolution  to 
this  problem  is  that  all  AWOS  AOl  type  stations  will  not  generate 
PWINO,  FZRNO,  or  RVRNO  remarks.  This  problem  was  classified  as 
Moderate/  remains  open,  and  will  be  corrected  in  the  Y2K  software 
build.  (Refer  to  PTR  OTE-015.) 

b.  Erroneous  WSHIFT  comments  were  generated  in  the  ADAS 
generated  METAR  messages.  DME  implemented  the  appropriate 
software  modifications  to  resolve  this  problem  and  the 
modifications  were  verified  as  correct  during  DT&E  #2  and  OT&E 
#2.  This  problem  was  classified  as  Moderate  and  has  been  closed. 
(Refer  to  PTR  OTE-020.) 

c.  ADAS  generated  PRES FR/ PRESRR  Remarks  that  were 
erroneous.  It  was  determined  during  OT&E  #1  that  the  Federal 
Standard  Algorithms  implemented  were  not  correct  and  that  the 
PRESRR  and  PRESFR  should  be  removed  from  build  4.19.  It  was 
tested  during  DT&E  #2  and  OT&E  #2  that  DME  had  removed  the  PRESRR 
and  PRESFR  Remarks  from  the  software.  AUA-430  continues  to 
investigate  how  these  remarks  should  be  implemented  and  what 
algorithms  should  be  used  to  generate  these  remarks.  It  has  not 
been  determined  if  the  appropriate  algorithms  will  be  identified 
and  implemented  for  the  Y2K  build.  Further  investigation  is 
needed  to  provide  the  appropriate  resolution  to  this  problem. 

This  problem  was  classified  as  Major  and  remains  open.  (Refer  to 
PTR  OTE-022 . ) 

4.4.11.1.3.2  PTRs  Generated. 

See  appendix  B  for  complete  PTR  details.  The  PTRs  generated  with 
respect  to  this  test  are: 

Moderate  PTR(s):  OTE-015  -  Open 

OTE-019  -  Closed 
OTE-020  -  Closed 
OTE-023  -  Closed 
OTE-024  -  Closed 

Major  PTR(s):  OTE-022  -  Open 

4.4.11.2  Informal  Testing. 

During  OT&E  #2  some  problems  were  reported  during  informal 
testing.  PTRs  were  generated  and  are  listed  below. 
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4.4.11.2.1  Significant  Problems. 

The  requirement  in  ADAS  System  Spec,  FAA-E-2804,  section 

3. 1.4. 1.2.1  states  that  ADAS  shall  vali-date  the  message  Format 
ID/Type  and  Message  Type/Length.  The  build  4.19  software  only 
validates  the  Message  Type/Length  for  AWOS  type  stations--not 
ASOS  type  stations.  Other  paragraphs  in  the  Spec  seem  to 
contradict  the  paragraph  identified  above.  As  a  result,  AUA  will 
correct  the  contradiction  in  the  spec  and  DME  will  be  directed  to 
validate  ASOS  type  stations.  This  problem  was  classified  as 
Major,  remains  open,  and  will  be  corrected  in  the  Y2K  software 
build.  (Refer  to  PTR  OTE-049.) 

4.4.11.2.2  PTRs  Generated.  • 

See  appendix  B  for  complete  PTR  details.  The  PTRs  generated  with 
respect  to  this  test  are: 

Moderate  PTR(s):  OTE-050  -  Closed 

OTE-051  -  Closed 

Major  PTR(s) :  OTE-049  -  Open 

5.  OT&E  CONCLUSIONS. 

ACT-320  provides  the  following  conclusions  based  on  OT&E  #1  and 
OT&E  #2: 

a.  All  of  the  Critical  Program  Trouble  Reports (PTR) 
generated  during  OT&E  #1  were  corrected. 

b.  Two  of  the  26  Operational  Test  and  Evaluations  (OT&E)  #1 
PTRs,  that  were  agreed  to  be  fixed  for  build  4.19,  were  not  fully 
addressed. 

c.  No  new  Critical  PTRs  were  generated  during  OT&E  #2. 

d.  As  a  result  of  OT&E  #2,  four  Major  and  three  Moderate 
PTRs  remain  open. 

e.  As  a  result  of  OT&E  #1  and  OT&E  #2,  there  are  a  total  of 
21  open  PTRs  that  remain  open  and  need  to  be  resolved. 

f.  Remote  Monitoring  System  (RMS)  testing  was  not  necessary 
during  OT&E  #2  since  none  of  the  OT&E  #1  PTRs  were  addressed  by 
build  4.19. 

g.  The  34  Automated  Lightning  Detection  and  Reporting 
System  (ALDARS)  related  NAS-SS-1000  requirements  (volume  II  and 
III)  were  nearly  all  implemented  correctly  as  indicated  by  the 
following:  for  82  percent  of  the  requirements,  testing  fully 
verified  AWOS  Data  Acquisition  System  (ADAS)  as  compliant;  for  12 
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percent  of  the  requirements,  testing  partially  verified  ADAS  as 
compliant;  and  testing  indicated  6  percent  of  the  requirements 
were  not  valid. 

h.  The  six  Integrated  Terminal  Weather  System 

(ITWS) -related  NAS-SS-1000  requirements  (volume  II)  were  nearly 
all  implemented  correctly  as  indicated  by  the  following:  for  83 
percent  of  the  requirements,  testing  fully  verified  ADAS  as 
compliant  and  for  17  percent  of  the  requirements,  testing 
partially  verified  ADAS  as  compliant. 

i.  The  32  'ME TAR-r elated  NAS-SS-1000  requirements  (volume 
II)  were  all  implemented  correctly  as  indicated  by  the  following: 
for  100  percent  of  the  requirements,  testing  fully  verified  ADAS 
as  compliant. 

Overall,  the  ADAS  software  version  4.19  is  robust,  and  the 
original  ADAS  functionality,  which  tested  successfully  for 
versions  4.18  and  4.19,  remains  intact.  All  OT&E  #1  PTRs _ 
designated  as  Critical  were  successfully  tested  and  verified  as 
corrected.  No  new  Critical  PTRs  were  generated  during  OT&E  #2. 

A  few  Major  PTRs  remain  open,  but  overall  do  not  present  a 
critical  problem. 

6 .  RECOMMENDAT I ONS . 

ACT-320  recommends  a  positive  deployment  decision  for  the  AWOS 
Data  Acquisition  System (ADAS ) /Automated  Lightning  Detection  and 
Reporting  System  (ALDARS)  software  build  4.19.  This  decision  is 
based  on  two  criteria:  (1)  there  are  no  outstanding  Critical 

Program  Trouble  Reports  (PTR) ,  and  (2)  all  of  the  21  open  PTRs 
appear  to  be  correctable.  ACT-320  recommends  that  the  remaining 
open  ADAS  software  PTRs  be  corrected  in  the  ADAS/Y2K  software 
build  and  that  the  ADAS  documentation  PTRs  be  corrected  before 
Y2K  Development  Test  and  Evaluation  (DT&E)  commences.  ACT-320 
recommends  that  all  corrected  software  PTRs  undergo  thorough  DT&E 
and  Operational  Test  and  Evaluation  (OT&E)  to  verify  that  the 
software  modifications  have  been  properly  implemented. 


7.  ACRONYMS  AND  ABBREVIATIONS . 


ACF 

ACT-320 

ADAS 

ADB 

ALDARS 

ARP 

ARTCC 


Area  Control  Facilities 

Comm/Nav/Surveillance  Engineering  and  Test  Division,  Weather 
Branch 

AWOS  Data  Acquisition  System 
Adaptation  Data  Base 

Automated  Lightning  Detection  and  Reporting  System 

Airport  Reference  Point 

Air  Route  Traffic  Control  Center 
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ASC  ADAS  Specialist  Console 

ASOS  Automated  Surface  Observation  System 

ATC  Air  Traffic  Control 

AWOS  Automated  Weather  Observation  System 

bps  bits  per  second 

CCN  Communications  Control 

CDL  Communications  DLP/WARP  Processing 

CHD  Communications  High  Level  Data  Link  Control  Processing 

CIT  Communications  ITWS  Processing 

CMP  Communications  Maintenance  Processor  Subsystem  Processing 

CONUS  Continental  United  States 

cps  characters  per  second 

CPU  Central  Processing  Unit 

CR  Cross  Reference 

CSCI  Computer  Software  Configuration  Item 

CTM  Communications  Transition  Modules 

CTS  Coded  Time  Source 

CWM  Communications  WMSCR  Processing 

DLP  Data  Link  Processor 

DMA  Direct  Memory  Access 

DME  DME  Corporation 

DP  Data  Point 

DT&E  Development  Test  and  Evaluation 

GAI  Global  Atmospherics,  Inc. 

FAA  Federal  Aviation  Administration 

HDLC  High  Level  Data  Link  Control 

Hz  Hertz 

I/F  Interface 

I/O  Input/Output 

ICC  Interface  Control  Card 

IPS  Interactive  Process  Simulator 

IRQ  Interrupt  Request 

ITWS  Integrated  Terminal  Weather  System 

IUC  IPS  Unix  Console 

Kb  kilobytes 
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LAA  Lightning  Activity  Area 

LAD  Lightning  Activity  Data 

LDD  Lightning  Detection  Data 

LHT  Lightning  Processing 

LMPA  Line  Monitor/Protocol  Analyzer 

LRU  Line  Replaceable  Units 

MB  megabytes 

MCC  Mission  Cycle  Control 

METAR  Aviation  Routine  Weather  Report 

MHz  megahertz 

MP  Maintenance  Processing 

MPS  Maintenance  Processor  Subsystem 

ms  millisecond 

MTBF  Mean  Time  Between  Failure 

NADIN  National  Airspace  Data  Interface  Network 

NAS  National  Airspace  System 

NCP  NAS  Change  Proposal 

NLDN  National  Lightning  Data  Network 

NLDN  National  Lightning  Detection  Network 

nmi  .  nautical  mile 

NRM  Normal  Response  Mode 

OEF  Operational  Evaluation  Facility 

0M0  One  Minute  Observation 

OT&E  Operational  Test  and  Evaluation 

PC  Personal  Computer 

PSF  Program  Support  Facility 

PSN  Packet  Switching  Network 

PTR  Program  Trouble  Report  . 

QFB  Quality  Factor  Bit 

RA  Reliability  and  Availability 

RMMS  Remote  Maintenance  Monitoring  System 

RMS  Remote  Maintenance  Subsystem 

RMS  Remote  Monitoring  System 

SCSI  Small  Computer  Systems  Interface 

SI  Specialist  Interface 
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SIR 

SFW 

SL 

SOW 

SPECI 

SRS 

SSR 

SUM 

SW/HW 

T&E 

TAF 

TCF 

TLCSC 

TSB 

TSE 

TSNO 

VDD 

VME 

WARP 

WDP 

WMSCR 

WSP 

Y2K 


Site  incident  Report 
Specified  Flash  Message 
System  Log 
Statement  of  Work 

Aviation  Selected  Special  Weather  Report 
System  Requirements  Specification 
Startup  Shut  down  Recovery 
Software  User  Manual 
Software/Hardware 
Test  and  Evaluation 
Terminal  Aerodrome  Forecast 
Test  Conduct  Form 

Top  Level  Computer  Software  Components 

Thunderstorm  Begin 

Thunderstorm  End 

Thunderstorm  No 

Version  Description  Document 

Versa  Module 

Weather  and  Radar  Processor 
Weather  Data/Conversion  Processing 
Weather  Message  Switching  Center  Replacement 
Weather  Storage  Processing 
Year  2000 
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APPENDIX  A 


TEST  VERIFICATION  REQUIREMENTS  TRACEABILITY  MATRIX 


ALDARS  OT&E  PLAN  MASTER  TVRTM  May  20,  1998 


10.  TEST  VERIFICATION  REQUIREMENT  TRACEABILITY  MATRIX  (TVRTM) 

The  ALDARS  TVRTM  contains  NAS -SS- 1000  Volume  II  and  Volume  III  requirements 
extracted  from  NCPs  14850  (METAR) ,  16133  (ALDARS),  and  17331 (ITWS) .  The  TVRTM 
is  comprised  of  five  tables,  one  table  for  each  NAS-SS-1000  Volume  in  each  of 
the  NCPs,  except  for  Volume  III  NAS-SS-1000  ITWS  requirements.  The  first 
entry  of  each  table  lists  the  source  document  of  the  requirements .  Each  of  the 
tables  are  framed  by  double  lines,  and  the  table's  last  entry  is  all  null 
fields  (i.e.  the  last  line  is  empty).  Therefore,  it  is  easily  determined  if  a 
table  is  continued  on  the  next  page  as  the  bottom  of  table  frame  is  a  single 
line  and  the  last  table  entry  on  the  page  is  not  empty. 

10.1.  COLUMN  DEFINITIONS  AND  UTILIZATION 

The  ALDARS  TVRTM  has  ten  columns  which  provide  the  following  information  for 
the  requirements: 

1)  Test  Description  ID#  -  Identifies  the  test  which  verifies 
compliance  with  the  ALDARS  or  METAR  requirement. 

2)  Requirement  Paragraph  Reference  -  Uniquely  identifies  each 

requirement  based  on  the  paragraph  number  of  the  paragraph 
containing  the  shall  statement  which  defines  the  requirement.  If 
the  paragraph  contains  a  single  requirement,  the  requirement  is 
identified  by  the  paragraph  number.  If  the  paragraph  contains 
multiple  shall  statements,  the  requirement  is  identified  by  the 
paragraph  number  followed  by  a  dash  (-)  and  a  positional  number, 
i.e.  3. 2. 1.5. 8-3  refers  to  the  third  shall  statement  in  paragraph 
3. 2. 1.5. 8.  If  a  shall  statement  has  multiple  objects  (i.e.  is  a 
compound  sentence,  or  refers  to  either  a  list,  figure,  or  table), 
the  requirement  is  identified  by  the  paragraph  number  followed  by 
a  dash  (-),  a  positional  number,  and  a  positional  letter,  i.e. 
3. 2. 1.5. 8 -lb  refers  to  the  second  object  of  the  first  shall 
statement  of  paragraph  3. 2. 1.5. 8.  If  the  requirement  is  from  a 
figure  or  a  table,  an  F  or  a  T  is  placed  between  the  dash  (-)  and 
the  positional  number,  i.e.  3 . 2 . 1 . 5 . 8 -Tlj  refers  to  the  first  item 
in  row  j  in  table  3. 2. 1.5. 8-1. 

3)  Description  -  provides  a  brief  description  of  the  requirement. 

4)  Test  Activity,  Integration  -  lists  the  verification  method  used 
during  OT&E  Integration  testing. 

5)  Test  Activity,  Operational  -  lists  the  verification  method  used 
during  OT&E  Operational  testing. 

6)  Threshold  MAOR  -  lists  the  Minimum  Acceptable  Operational 
Requirements  (MAOR)  which  are  the  stated  thresholds  for 
operational  performance  below  which  the  system  will  not  meet 
mission  needs. 

7)  EC  COI  CPP  -  lists  any  Exit  Criteria  (EC),  Critical  Operational 
Issues  (COI) ,  and/or  Critical  Performance  Parameters  (CPP) 
associated  with  the  requirement. 


A-l 


8)  Test  Plan  Paragraph  /  Remarks  -  Lists,  the  OT&E  Test  Plan 
Paragraph  which  addresses  the  requirement,  and  any  remarks 
associated  with  the  requirement. 

9)  Test  Proc  Paragraph  /  X-Ref  -  Lists,  the  OT&E  Test  Procedure 
Paragraph  which  addresses  the  requirement,  and  all  associated  test 
data  cross-reference  numbers  (CRxx's) .  CRxx's  are  redlined  in  the  | 
procedure's  'Evaluation  Criteria'  and  'Expected  Test  Data" 
paragraphs. 

The  verification  method  listed  in  the  Test  Activity  columns  will  be  one  of  the 
following : 


T  =  Test 

D  =  Demonstration 
A  =  Analysis 
I  =  Inspection 

L  =  Verified  by  Lower  Layer  Requirement (s) 

X  =  Not  Applicable 

Q  =  Deferred  Qualification  Requirement  (Does  Not  Exist  In  NAS  Now) 

P  =  Previously  Qualified  (Exists  In  NAS  But  Will  Not  Be  Re -Demonstrated) 
R  =  Previously  Qualified  And  Will  Be  Re -Demonstrated 


A- 2 


A- 3 


LSS2-023  I  Vol.  II  Table  ADAS  to  ASOS/AWOS  T  T  152  bits  per  minute 


ALDARS/METAR  TEMP  VERIFICATION  REQUIREMENTS  TRACEABILITY  MATRICES  (TVRTMs) 


A- 8 


A- 11 


MSS3-021  Vol.  Ill  I  ASPS  Dewpoint  Precision  T  T  ±2°F  RMSE  (from  +30  Report  in 


A- 15 


■2-5  ADAS  NAS-SS-1000  Volume  n  ITWS  Requirements 

FAA  TEMP  VERIFICATION  TRACEABILITY  MATRIX 


IT-01  -  {4102-6}  Channel  Connection  Test  FST  (ITWS)  ISS2-001 

IT-02  -  {4231-1 }  DLP  /  ITWS  /  WARP  Buffering  ISS2-002.  ISS2-003.  ISS2-005.  ISS2-006 

IT-03  -  {4232-1 }  DLP  /  ITWS  /  WARP  Variable  Length  Messages  ISS2-002.  ISS2-003,  ISS2-005,  ISS2-006 

rr-04  -  {4331-1 }  DLP  /  ITWS  /  WARP  Message  Errors 

IT-05  -  ITWS  Functional/Physical  Setup  ISS2-004 


APPENDIX  B 


PROGRAM  TROUBLE  REPORTS 


AT. PARS  PTR  DETAILED  REPORT  -  ALL 

OTE-OOl  ■  • 

NLDN  Serial  Buffer  Backup 


PTR  Open 

— 

PTR  Accepted 

y 

Discover  Date 

8/4/97 

Failure  Category 

System 

Criticality 

Critical 

Originator 

Vuong 

Location 

ADAS  PSF 

Software  Version 

4.18/3.12 

Related  PTRs 

DME  PCR  #  284 

During  the  NLDN  interface  test,  the  communication  status 
between  NLDN  and  ADAS  fails.  The  reasons  are 

1.  a)  When  ADAS  is  down,  the  serial  buffer  box  fills  up 
with  LDD. 

b)  Then  ADAS  comes  back  up  after  a  few'  hours,  the  serial 
buffer  box  does  not  reestablish  the  communication. 

c)  If  ADAS  comes  back  up  after  a  few  minutes,  the  serial 
buffer  box  does  re-establish  the  communication. 

2.  a)  When  ADAS  is  down,  the  serial  buffer  box  fills  up 
with  LDD. 

b)  Then  ADAS  is  up.  the  serial  buffer  box  does  not  flush 
out  the  old  LDD. 

Meanwhile,  in  order  to  establish  a  communication  between 
ADAS  and  NLDN,  operator  needs  to  hit  the  reset  button  of 
the  serial  buffer  box. 

8/21/97 -DGG 

Came  in  and  NLDN  system  was  not  displaying  lightning 
data.  Checked  patch  panel  and  cables  and  all  was  OK.  When 
Reset  on  NLDN  Serial  Buffer  Box  was  performed 
communications  resumed  to  normal  and  lightning  began  to  be 
displayed.  This  indicates  the  criticality  of  this  problem.  Had 
this  been  an  operational  ADAS,  no  LDDs  w'ould  have  been 
sent  and  a  manual  Reset  of  the  buffer  box  would  have  been 
necessary.  From  an  operational  standpoint  this  is 
unacceptable. 


Affected  Reqs 

Discrepancy 

Discription 


PTR# 
PTR  Title 


B-l 


ALDARS  PTR  DETAILED  REPORT  -  AT  T. 


9/5/97  DGG 

Further  tests  were  run  earlier  in  the  week  to  determine  if 
ADAS  would  begin  communicating  with  the  buffer  box 
when  reconnected  after  several  hours  of  being  disconnected. 
Tests  revealed  that  ADAS  would  begin  communicating  again, 
however,  the  problem  still  remains  that  hours  of  old  data  are 
sent  to  ADAS. 

Recommendation  DME  has  already  stated  that  they  plan  to  increase  the  baud 
rate  to  19,200  when  ADAS  starts  up  to  ensure  that  all  old 
data  stored  in  NLDN  serial  buffer  box  is  "drained  off'.  It 
also  needs  to  be  verified  that  ADAS  begins  communicating 
properly  with  the  NLDN  buffer  box  (ACT  had  problems  just 
getting  comm  between  ADAS  and  buffer  box  without  hitting 
reset  on  buffer  box). 

8/21/97 -DGG 

Based  on  the  problems  described  above,  the  Serial  Buffer 
Box  should  not  be  used  operationally.  DME  needs  to 
investigate  this  problem  further  and  come  up  with  an 
alternate  solution. 

9/5/97  DGG 

Although  there  does  not  seem  to  be  a  problem  with 
reconnecting  after  comm  is  down,  there  still  needs  to  be  a  fix 
to  the  old  data  that  is  sent  to  ADAS.  As  OT&E  goes  on 
further  tests  will  be  performed  to  determine  if  there  are  any 
other  unacceptable  operational  issues  related  to  the  use  of  the 
serial  buffer  box. 

1 1/25/97  -  DGG 

At  PMR  it  was  confirmed  that  this  PTR  would  be  addressed 
by  DME  in  build  4.19. 

Action  Taken 

Notes  Although  DME  has  this  as  a  PCR  and  plans  to  implement 

changes.  ACT  created  a  PTR  to  ensure  that  this  is  regression 
tested  for  build  4.19. 
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AT, PARS 

PTR  # 

PTR  Title 

PTR  Open 
PTR  Accepted 
Discover  Date 
Failure  Category 
Criticality 
Originator 
Location 
Software  Version 
Related  PTRs 

Affected  Reqs 

Discrepancy 

Discription 


Recommendation 


Action  Taken 


PTR  DETAILED  REPORT  -  ALL 


OTE-002 

IPS  X.25  Board  Failure 

7 

8/4/97 

System 

Moderate 

Groot 

ADAS  PSF 

4.18/3.12 


At  the  start  of  tests  AL-03  on  7/31  and  AL-04  on  8/4  message 
on  ISC  came  up  that  test  started  but  on  IUC  received  multiple 
messages  of  all  the  S  Pongs  had  failed  (see  log  book  for 
record  of  what  was  on  IUC):  The  red  light  for  the  IPS  X.25 
card  came  on  and  the  test  terminated  although  the  LDD  script 
had  never  been  started.  Both  IPS  and  ADAS  systems  were 
shutdown  and  brought  back  up,  but  red  light  remained  on. 

11/07/97  DGG 

The  problem  ended  up  being  that  the  cables  had  come  loose 
and  therefore  the  problem  was  intermittent. 

Although  this  seems  likely  to  be  an  IPS  problem,  it  is  unclear 
why  this  problem  didn't  start  occurring  until  after  4.18  was 
officially  loaded  on  7/23.  Up  until  then  this  problem  never 
occurred  through  numerous  dry  runs  of  these  exact  tests. 

DME  needs  to  investigate  this  problem  further  and  determine 
that  it  in  fact  is  IPS  and  not  ADAS  related. 

Although  the  problem  still  exists,  a  work  around  has  been 
incorporated  to  clear  the  problem. 

9/5/97  DGG 

Ed  Schlain  recalled  a  similar  problem  in  the  past.  Two 
converters  were  removed  in  the  connection  from  ADAS  to 
IPS.  So  far  no  problems  have  occurred. 
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ALDARS  PTR  DETAILED  REPORT  -  AT  T 

1 1/7/97  DGG 

The  solution  was  to  recable  and  to  implement  the  use  of  a 
switch  box.  Therefore  this  PTR  is  closed. 

Notes  Jock  made  some  printouts  of  data  that  may  be  useful  in 

analyzing  this  error.  DGG 

Ed  states  this  occurs  due  to  the  PQAD  (pretty  quick  and 

dirty)  of  the  IPS,  which  originally 

was  only  to  be  a  DT&E  testbed  stubs  &  drivers  tool. 

CommPower's  OSI  software  for  the  IPS  X.25  was  a  PQAD 
conversion  of  the  software  delivered  from  ONE  for  the 
ADAS  X.25  OSI.  JKS 

9/2/97  -  Error  occurred,  and  when  cleared,  would 
immediately  re-occur  when  an  IPS  test  was  started.  Error 
was  finally  cleared  and  successfully  communications  re¬ 
established  when  the  ADAS  &  IPS  were  directly  connected, 
by-passing  the  Patch  Panel  &  RS-232/RS-530  converters.  As 
the  PST  testbed  has  had  numerous  problems  with  the 
converters  going  bad,  it  currently  seems  that  the  X.25  card 
error  is  related  to  failure  of  1,  or  both,  converters.  JKS 
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AT, PARS 

PTR  # 

PTR  Title 

PTR  Open 
PTR  Accepted 
Discover  Date 
Failure  Category 
Criticality 
Originator 
Location 

Software  Version 
Related  PTRs 

Affected  Reqs 

Discrepancy 

Discription 

Recommendation 


Action  Taken 
Notes 


PTR  DETAILED  REPORT  -  ALL 


OTE-003 

AWOS/ASOS  Message 


y 

8/6/97 

Software 

Moderate 

Vuong 

ADAS  PSF 

4.18 


AWOS/ASOS  message  from  ADAS  to  WMSCR  is  more 
than  69  characters.  Therefore  it  causes  a  problem  for 
WMSCR  to  process  weather  data  properly. 

AOS  branch  needs  to  incorporate  necessary  software  changes 
to  eliminate  the  messages  with  more  than  69  characters. 

1 1/7/97  -  HHV 

AUA  needs  to  determine  AOS  branch  or  DME  Corp.  for 
fixing  the  problem. 

1 1/25/97  -DGG 

It  was  decided  at  the  PMR  that  this  will  be  implemented  for 
the  build  4.19.  If  AOS  gets  DME  the  change  promptly,  then 
DME  will  incorporate  the  change.  However,  if  AOS  wants  to 
extend  field  testing  of  change  and  therefore  not  provide  DME 
the  change  in  advance  of  DT&E,  then  AOS  will  incorporate 
into  build  4.19  after  OT&E. 

2/25/98  -  HHV 

AOS  needs  to  incorporate  the  software  changes  into  build 
4.19. 
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ALDARS 


PTR  # 

PTR  Title 

PTR  Open 
PTR  Accepted 
Discover  Date 

Failure  Category 
Criticality 
Originator 
Location 
Software  Version 
Related  PTRs 

Affected  Reqs 

Discrepancy 

Discription 


Recommendation 


PTR  DETAILED  REPORT  -  AT  T. 

OTE-004 

ITWS  Reconnect  AWOS  Error 


Z 

8/18/97 

Software 

Moderate 

Stratton 

ADAS  PSF 

4.19/4.18/3.12 


During  test  IT-01,  the  6  ITWS  simulators  are  disabled  for  30 
seconds  during  the  3rd 

mission  cycle.  After  the  simulators  are  re-enabled,  the  ITWS 
simulators  receive 

lightning  data  msgs,  but  do  not  receive  AWOS  msgs. 

2/1 1/98  -  JKS  :  Original  test,  which  disables  the  ITWS’s  after 
the  3rd  ADAS_AWOS_POLL  still  fails!  Modified  version  of 
test,  which  waits  for  30  seconds  after  the  3rd 
ADAS_AWOS_POLL  before  disabling  the  ITWS's,  works 
correctly  -  with  both  AWOS  OMO's  and  NLDN  LDD's  being 
sent  to,  and  receive  by  the  IPS  ITWS’s. 

2/20/98  -  JKS  :  Tested  AOS  fix  to  CSC  ’cit_out’  -  Test 
PASSED  indicating  AOS  fix  has  corrected  the  problem. 

DME  needs  to  research  error,  and  fix  if  on  the  ADAS  side. 

1 1/25/97  -  DGG 

At  PMR  it  was  confirmed  that  this  PTR  would  be  addressed 
by  DME  in  build  4.19. 

2/10/98  -  JKS  :  DME  must  update  the  ITWS  output  logic  to 
correctly  handle  ITWS  comm  failures  when  they  occur  after 
ADAS  Polls  the  AWOS's  and  prior  to  ADAS  OMO  output  to 
the  ITWS's.  (ADAS  correctly  handles  failures  that  occur 
after  ADAS  OMO  output  to  the  ITWS's  and  prior  to  the 
beginning  of  the  next  mission  cycle. 

B-6 


ALDARS  PTR  DETAILED  REPORT  -  ALL 


2/20/98  -  JKS-  ACT-320  must  monitor  AOS  updating  of 
delivered  software  prior  to  delivery  to  field  sites. 

Action  Taken  AOS  delivered  an  updated  'cit  out'  binary.  ACT-320  testing 

confirmed  ADAS  fully  reconnects  with  ITWSs. 

JKS  23Mar98  -  Testing  of  the  AOS  Deployment  build  verify 
correction  of  the  ITWS  reconnection  problem. 

Notes  Re-verify  in  Deployment  build. 
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AT.DARS 


PTR  # 

PTR  Title 

PTR  Open 
PTR  Accepted 
Discover  Date 

Failure  Category 
Criticality 
Originator 
Location 
Software  Version 
Related  PTRs 

Affected  Reqs 

Discrepancy 

Discription 


Recommendation 

Action  Taken 


PTR  DETAILED  RF.PORT  -  ATI, 


OTE-005 

Event  Type  35  Notification 


y 

08/20/97 

Software 

Moderate 

Stratton 

ADAS  PSF 

4.18/3.12 


When  one  of  the  DLP  communication  processes  is  killed 
(cdljo  -d),  No  Child  Death  message  appears  at  the  AUC,  no 
entries  are  made  in  to  the  error  log,  and  no  event  type  35 
entries  appear  in  the  event  log. 

The  test  killed  the  process  6  times  during  mission  cycles  2 
through  9,  and  ADAS  restarted  the  process  without 
indication  at  the  AUC,  ASC,  or  in  the  logs.  ADAS  does 
not  seem  to  re-establish  communication  with  the  DLP, 
because  the  test  procedure  kills 

the  first  'cdljo  -d'  process  in  the  'ps  -eaf  list  within  1  to  2 
minutes  of  the  starting  of  the 

new  process.  ADAS  indicated  neither  an  event  type  1  - 
"Status  of  the  DLP 

connection  has  changed",  nor  an  event  type  35  -  "A  UNIX 
process  within  ADAS  has 
died"  at  any  time  during  the  test. 

DME  should  report  an  event  type  35  when  the  'cdljo  -d' 
process  is  terminated, 

and  an  event  type  1  when  ADU's  are  no  longer  being 

transferred  to  the  DLP  by 

ADAS. 

To  determine  if  ADAS  resumes  DLP  comm,  the  test  will  be 
re-run  with  all  logs  on  and  the  process  will  be  killed  only 
once.  Collected  data  will  be  forwarded  to  DME. 

12/2/97  -  DGG 
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AT. PARS  PTR  DETAILED  REPORT  -  ALL 


Received  a  memo  for  Dan  Casey,  AOS-500,  to  help  clarify 
this  problem.  Since  this  is  only  a  problem  that  occurs  as  a 
result  of  a  manual  "killing"  this  PTR  will  be  closed. 

Notes  The  test  run  was  9  mission  cycles  long,  and  the  process  was 

killed  6  times  after  the  1st  cycle.  Therefore  the  ADAS  might 
have  re-established  comm  if  given  time.  Test  will  be  re-run 
with  all  logs  on  ('Setlog  50')  and  the  process  will  be  killed 
only  once.  Data  gathered  will  be  forwarded  to  DME  with 
PTR-004  data  for  analysis. 

12/2/97 -DGG 

See  attached  memo  from  Dan  Casey,  AOS-500. 
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ATDARS 

PTR  # 

PTR  Title 

PTR  Open 
PTR  Accepted 
Discover  Date 

Failure  Category 
Criticality 
Originator 
Location 
Software  Version 
Related  PTRs 

Affected  Reqs 

Discrepancy 

Discription 

Recommendation 

Action  Taken 


Notes 


PTR  DETAILED  REPORT  -  AT  T. 


OTE-006 
Setlog  50  Error 


V 

08/20/97 

Software 

Minor 

Stratton 

ADAS  PSF 

4.18/3.12 


The  "Setlog  50"  command  was  executed  and  then  an  ADAS 
"clean"  start  was  performed.  Prior  to  reaching  the 
operational  state,  ADAS  displayed  several  error  msgs  at  the 
AUC  indicating  illegal  Setlog  value. 

DME  needs  to  tweak  their  software  modules  to  except  a  value 
of  50,  even  if  40  is  the  modules  highest  setting,  so  when  the 
"Setlog  50"  command 

To  determine  if  ADAS  resumes  DLP  comm,  the  test  will  be 
re-run  with  all  logs  on  and  the  process  will  be  killed  only 
once.  Collected  data  will  be  forwarded  to  DME. 

1 1/06/97  DGG 

Jock/DME  agree  that  PTR  can  be  closed. 

The  test  run  was  9  mission  cycles  long,  and  the  process  was 
killed  6  times  after  the  1st  cycle.  Therefore  the  ADAS  might 
have  re-established  comm  if  given  time.  Test  will  be  re-run 
with  all  logs  on  ('Setlog  50')  and  the  process  will  be  killed 
only  once.  Data  gathered  will  be  forwarded  to  DME  with 
PTR-004  data  for  analysis 
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PTR# 

PTR  Title 
PTR  Open 
PTR  Accepted 
Discover  Date 

Failure  Category 
Criticality 
Originator 
Location 
Software  Version 
Related  PTRs 

Affected  Reqs 

Discrepancy 

Discretion 


Recommendation 


Action  Taken 


OTE-007 

AWOS  Station  Lat/Long  Edit  Adaptation  Error 


is/ 

8/27/97 

Software 

Critical 

Groot 

ADAS  PSF 
4.18 

DME  PCR  285 
OTE-030 


OT&E  test  AL-09  requires  the  capability  to  "move"  AWOS 
stations  into  an  area  of  lightning  activity.  The  AWOS  station 
was  "moved"  using  the  Edit  Working  Adapt  and  Install 
Working  Adapt  commands.  Display  Working  Adapt  seemed 
to  indicate  that  the  Lat/Long  for  the  station  had  been  changed 
to  the  appropriate  location  (i.e..  when  the  Edit  and  Install  was 
completed  "success"  was  indicated  on  the  screen).  However, 
the  test  was  completed  and  no  lightning  strikes  were  reported 
to  the  station  despite  the  apparent  overlap  of  the  lightning 
with  the  station.  It  appears  that  although  the  correct  Lat/Long 
was  displayed  for  the  station,  in  fact  the  station  hadn't  moved 
from  the  original  configuration  file  location. 

The  test  was  rerun  with  the  station's  Lat/Long  changed  in  the 
configuration  file.  With  this  setup  the  lightning  was  reported 
to  the  AWOS. 

DME  needs  to  change  the  software  so  that  the  Edit  Working 
Adapt  and  Install  Working  Adapt  work  properly  for  the 
stations. 

1 1/25/97 -DGG 

At  PMR  it  was  confirmed  that  this  PTR  would  be  addressed 
by  DME  in  build  4.19. 

DME  has  already  been  working  on  this  problem  since  they 
were  informed  of  this  during  OT&E  dry  runs. 
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2/24/98  DGG 

This  PTR  was  verified  as  fixed  during  tests  for  AL-09, 
therefore  this  PTR  is  closed. 

Notes  Although  DME  has  generated  a  PCR,  this  problem  will  also 

be  tracked  by  an  OT&E  PTR  so  that  it  can  be  verified  as 
fixed  during  follow  on  OT&E. 
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PTR# 

OTE-008 

PTR  Title 

No  Automated  Remarks  from  OTIS 

PTR  Open 

□ 

PTR  Accepted 

V 

Discover  Date 

8/27/97 

Failure  Category 

Other 

Criticality 

Major 

Originator 

Groot 

Location 

ADAS  PSF 

Software  Version 

Related  PTRs 

OTE-031 

Affected  Reqs 

Discrepancy 

Discription 

During  test  AL-09  on  8/27/97  from  14:41,  the  OTIS  AWOS 
never  reported  any  Automated  Remarks  for  Lightning.  OTIS 
did  report  TSB44,  but  never  reported  any  lightning  for  any  of 
the  sectors,  vicinity  or  at  airport. 

8/29/97  DGG 

It  seems  from  analyzing  AL-09-3  data,  that  this  problem  does 
reside  within  ADAS.  The  DLP  AWOS  log  revealed  that 

OTIS  sent  a  LTG  DSNT  NW.  However,  the  SPECI,  which  is 
generated  by  ADAS  did  not  include  this  remark. 

10/22/97  DGG 

Upon  review  of  data  Greg  Kupi  noted  that  the  remarks  that 
OTIS  sent  back  were  incorrectly  placed  in  the  OPERATOR 
REMARKS  section.  Therefore  the  problem  is  with  the 

AWOS  software. 

1 1/06/97 

Joe  Gibson  pointed  out  that  the  remarks  end  with  an  !  and 
therefore  would  indicate  that  AWOS  is  sending  them  back 
proper!}'.  For  now,  then,  we'll  classify  as  an  ADAS  problem 
and  will  be  reported  as  such  in  the  Quick  Look  Report. 
However,  this  could  be  changed  if  further  analysis  reveals  it 
is  an  AWOS  problem. 

11/25/97 -DGG 

The  problem  is  that  a  space  has  been  added  to  the  automated 
lightning  remarks  and  therefore  when  ADAS  code  checks  oct 
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69  and  finds  it  blank  it  assumes  no  auto  remarks. 

Recommendation  This  problem  does  not  seem  to  reside  in  the  ADAS,  therefore 
the  AWOS  program  office  needs  to  be  informed  of  this 
problem  and  the  AWOS  software  must  be  corrected.  ??????? 
Need  to  verify  this  statement??????? 

8/29/97  DGG 

The  previous  statement  is  not  true.  Based  on  data  from  AL- 
09-3,  the  problem  resides  with  ADAS  not  generating  the 
LTG  DSNT  NW  remark  in  the  SPECI.  DME  needs  to  fix 
this  problem. 

10/22/97  DGG 

Since  the  problem  is  that  the  AWOS  places  the  remarks  in  the 
OPERATORS  REMARKS,  the  AWOS  software  needs  to  be 
corrected. 

1 1/06/97  DGG 

Since  it  seems  to  be  a  ADAS  problem,  Joe  G  was  going  to 
talk  to  Greg  about  looking  into  this.  If  the  problem  is  with 
ADAS,  DME  needs  to  fix  the  software. 

11/25/97 -DGG 

Although  the  problem  resides  with  the  AWOS  adding  in  a 
blank  space  at  oct  69,  the  solution  will  be  to  update  the  1CD 
and  then  have  DME  change  code  to  allow'  for  blank  space  in 
oct  69  but  still  get  the  auto  lightning  remarks.  This  will  be 
addressed  in  build  4.19. 

Action  Taken  2/24/98  -  DGG 

Data  from  OTE  #2  al-02c-l  .cap  verifies  that  OTIS  remarks 
are  in  the  SPECIs,  therefore  this  PTR  is  closed. 

4/9/98  -  DGG 

ICD  par  10.3.20  was  modified  to  complete  the  resolution  of 
this  PTR. 

Notes 
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PTR# 

OTE-009 

PTR  Title 

Automated  Lightning  Remarks  Contradiction 

PTR  Open 

V 

PTR  Accepted 

V 

Discover  Date 

8/27/97 

Failure  Category 

Documentation 

Criticality 

Moderate 

Originator 

Groot 

Location 

ADAS  PSF 

Software  Version 

4.18 

Related  PTRs 

OTE-008.  OTE-031 

Affected  Reqs 

ADAS/A WOS  ICD  par  10.3.20.1,  30.3.3,  Table  30-3.  and 
90.3.2.12.1.4.2 

ADAS  Spec  par  3. 1.4. 2.3 .2. 5. 2 

Discrepancy 

Discription 

Paragraph  10.3.20.1  of  the  ADAS/AWOS  ICD  states  that 
"the  automated  remark  pertaining  to  lightning  shall  be 

formatted  and  inserted  in  the  AWOS  Format  Message 
automated  remarks  field  in  accordance  with  the  requirements 
stated  in  Appendix  III."  Appendix  III  then  goes  on  to  define 
that  automated  remarks  are  to  be  generated  for  AT  ARPT, 
VCNTY,  and  DATA  MISSING.  However,  the  ADAS  Spec 
in  paragraph  3. 1.4. 2, 3.2. 5.2  never  addresses  the  conditions 
for  generating  the  ARPT,  VCNTY,  or  DATA  MISSING 
automated  lightning  remarks.  Paragraph  3. 1.4. 2. 3. 2. 5.2 
DOES  reference  the  ADAS/ AWOS  ICD  Table  30-3.  This 
table  DOES  address  the  ARPT,  VCNTY  and  DATA 
MISSING  remarks.  Although  it  is  somewhat  unclear,  it  does 
seem  that  since  the  ADAS  Spec  references  ICD  Table  30-3, 
that  the  ARPT,  VCNTY,  and  DATA  MISSING  remarks 
should  be  generated.  DME  has  not  included  these  three 
remarks  into  the  LAD  message  Field  3  and  as  a  result  the 
AWOS  and  ASOS  OMO  and  SPECI  and  METAR  messages 
do  not  contain  these  remarks. 

Recommendation  A  decision  needs  to  be  made  as  to  whether  ARPT,  VCNTY. 

and  DATA  MISSING  should  be  included  in  the  Automated 
Remarks.  Whatever  the  decision,  the  documentation  needs  to 
be  corrected  to  avoid  this  contradiction. 

1 1/07/97  DGG 

AUA  needs  to  update  the  documentation. 
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1 1/25/97  -  DGG 

At  the  PMR  it  was  agreed  that  AUA  would  change  ICD  table 
30-3. 

2/24/94  DGG 

As  of  this  date  ACT-320  has  not  been  informed  that  the 
change  has  been  made. 

Action  Taken  4/9/98  -  DGG 

AUA  indicated  that  the  ICD  paragraphs  30.3.3  and  30.40.1 
and  table  30-3  would  be  changed  to  correct  this  problem. 

Notes 
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PTR# 

PTR  Title 
PTR  Open 
PTR  Accepted 
Discover  Date 

Failure  Category 
Criticality 
Originator 
Location 
Software  Version 
Related  PTRs 

Affected  Reqs 

Discrepancy 

Discretion 


Recommendation 


OTE-OIO 

AWOS  Thunderstorm  Begin/End  Failure 

✓ 

8/27/97 

Software 

Major 

Groot 

ADAS  PSF 

4.18 

OTE-032 


During  Test  AL-09-1  a  thunderstorm  begin  was  reported  as 
TSB44  (i.e..  1444),  however  no  TE  was  ever  generated  and 
eventually  the  TSB44  was  dropped  out  of  the  reports.  Then 
at  1700  METAR  there  was  a  TSB24  (supposedly  for  1624, 
although  no  SPECI  had  been  generated  for  that  time).  It  was 
not  known  yet  whether  this  is  an  AWOS  or  ADAS  problem. 

10/21/97  DGG 

AL-02C-4  data  was  found  to  have  the  same  problem.  It 
appears  that  it  is  a  problem  with  ADAS  not  correctly  using 
the  Octet  57/58  data  for  determining  TSBhhmmEmm  remarks. 

11/25/97 -DGG 

The  original  discrepancy  description  discussed  the  1700 
METAR  and  the  associated  TSB24.  This  TSB24  was 
correct.  The  SPECI  was  not  required  at  1624  because  of  the 
5  minute  window  to  check  for  Sped  generation.  However, 
the  other  aspect  of  this  PTR  is  still  a  problem. 

Either  the  AWOS  software  or  ADAS  software  needs  to  be 
corrected. 

10/21/97  DGG 

Upon  further  inspection  it  appears  that  this  is  an  ADAS 
problem  and  therefore  DME  will  have  to  fix  the  software. 

11/25/97  -DGG 

As  discussed  at  PMR,  DME  will  implement  fix  to  take  care 
of  "lost”  TSE.  This  will  be  corrected  in  Build  4.19. 
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Action  Taken  2/24/98 -DGG 

This  PTR  was  fixed  as  verified  by  data  in  al-02c-l.cap  and 
therefore  this  PTR  is  closed.  However,  a  new,  related 
problem  occurred  during  testing  and  therefore  PTR  OTE-052 
was  generated. 

Notes  10/21/97- DGG 

The  following  e-mail  message  was  sent  to  DME  on  10/21/97: 

Attached  is  the  data  for  PTR  OTE-0 10.  The  Metar  messages 
and  OMOs  are  included  in  the  file  al-02c-4.cap. 

Here  is  an  example  of  what  seems  to  be  a  problem: 

There  is  SPECI  as  follows: 

SPECI  OTIS  142047Z  AUTO  14008KT  10SM  TS  FEW049 

17/06  A3018RMK  A01 

TSB52 

and  another  one  as  follows: 

SPECI  OTIS  1 42 1 02Z  AUTO  1 4006KT  1 OSM  FEW049 
17/07  A3018RMK  A01 

The  corresponding  OMOs  are  as  follows: 

AWOS/ASOS  ID:  OTIS  AWOS/ASOS  CFG  NO:  A240 
DATE:97/10/14  TIME:  20:47:00  ALERT 

STATUS: 

Tstorm  Beg:  No  Funnel:  No  Snow  Beg:  No 
NonSpecBeg:No  Tstorm  End:  No  Spout:  No  Snow 
End:  No  NonSpecEnd:No  Tstorm  Inc:  No 
LIGHTNING  ACTIVITY:  Special,  Status,  0-5,  5-10: 

0x4 1  8  Sectors 

10-30:  0x0 
SITE  STATUS: 

Operator:  No  Test  Mode:  No  Manual  Msg:  No  Suspect 
Data:  No 

SENSOR/DATA  STATUS: 

Wind  Speed:  0  Ceiling  Accum:  0  RVR:  2 

AUTOMATED  REMARKS: 

Var  visibility:  No  Var  Wind:  No  Var  ceil/sky:  No 
Lightning:  No 

OPERATOR  REMARKS: 

and  also: 

AWOS/ASOS  ID:  OTIS  AWOS/ASOS  CFG  NO:  A240 
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DATE:97/10/14  TIME:  21:02:00  ALERT 

STATUS: 

Tstorm  Beg:  No  Funnel:  No  Snow  Beg:  No 
NonSpecBeg:No  Tstorm  End:  No  Spout:  No  Snow 
End:  No  NonSpecEnd:No  Tstorm  Inc:  No 
LIGHTNING  ACTIVITY:  Special,  Status,  0-5,  5-10:  0x1 
8  Sectors 
10-30:0x0 
SITE  STATUS: 

Operator:  No  Test  Mode:  No  Manual  Msg:  No  Suspect 
Data:  No 

AUTOMATED  REMARKS: 

Var  visibility:  No  VarWind:No  Var  ceil/sky:  No 
Lightning:  No 

OPERATOR  REMARKS: 

Based  on  ICD  Table  90-6, 1  believe  that  there  should  have 
been  a  remark  "TSBhhmmEmm"  for  the  SPECI  at  2102Z. 
Although  OTIS  did  not  send  any  Thunderstorm  Begin  or  End 
indications  in  the  Alert  Data  field  (PTR  OTE-036),  that 
should  be  irrelevant  since  ADAS  is  supposed  to  use  Octets  57 
and  58  as  the  source  of  TSBhhmmEmm  remarks. 

You  can  find  this  information  and  other  examples  of  this  in  al- 
02c-4.cap. 

Let  me  know  if  you  need  any  more  info. 
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PTR  # 

PTR  Title 

PTR  Open 
PTR  Accepted 
Discover  Date 

Failure  Category 
Criticality 
Originator 
Location 
Software  Version 
Related  PTRs 

Affected  Reqs 

Discrepancy 

Discription 


Recommendation 


Action  Taken 
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OTE-Oll 

ADAS  Shutdown  Failure 


V 

8/27/97 

System 

Critical 

Stratton 

ADAS  PSF 

4.18/3.12 

PTR-004 


Test  OP-01 :  When  ADAS  shutdown  request  is  issued  at  the 
ASC  while  the  IPS  test  was  running,  the  AUC  indicated  a 
graceful  shutdown  request,  but  the  ADAS  did  not  shutdown. 
After  the  request  was  issued,  pongs  1-4  closed  and  re-round, 
after  the  'stop  adas'  command  was  issued  at  the  AUC,  pongs 
5-A  closed  and  rebound.  When  the  ASC  shutdown  request 
was  issued  after  termination  of  the  IPS  test,  the  ADAS 
promptly  shutdown, 

DME  needs  to  investigate  the  problem. 

Symptoms  indicate  this  is  a  problem  resulting  from  the  new 
IPS  X.25  simulators  added  to  the  OSI  stack.  The  IPS  PQAD 
upgrade  has  induced  numerous  errors  in  IPS  operation  and 
ADAS/IPS  communication.  The  FAA  needs  to  acquire  from 
the  engineering  data  related  to  add  adding  additional 
pongs(pings)  to  the  OSI  stack  from  DME.  The  FAA  then 
needs  to  determine  the  best  way  to  have  the  IPS  problems 
fixed. 

DME  has  determined  that  a  table  ADAS  accesses  to  perform 
a  graceful  shutdown  need  to  be  updated  with  the  ITWS 
process  names. 

1 1/25/97  -  DGG 

At  PMR  it  was  confirmed  that  this  PTR  would  be  addressed 
by  DME  in  build  4.19. 

ADAS  OT&E  Regression  Testing  demonstrates  that  this 
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Notes 


problem  has  been  fixed. 
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PTR  Title 
PTR  Open 
PTR  Accepted 
Discover  Date 

Failure  Category 
Criticality 
Originator 
Location 
Software  Version 
Related  PTRs 

Affected  Reqs 

Discrepancy 

Discription 


Recommendation 


Action  Taken 
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OTE-012 

Thunderstorm  Begin/End  Timestamp  Error  for  Metars 


[✓ 

8/28/97 

Software 

Critical 

Groot 

ADAS  PSF 

4.18 


While  running  AL-09  test  (version  2),  noticed  that  the  ADAS- 
generated  METAR/SPECI  messages  had  conflicting  time 
information  for  the  Thunderstorm  Begin/End  Automated 
Remarks.  The  time  stamp  placed  at  the  beginning  of  the 
METAR/SPECI  was  2  minutes  earlier  than  when  the 
Automated  Remark  indicated  that  the  Thunderstorm  Begins 
or  Ends.  Here  is  a  sample  of  what  was  observed  and 
recorded. 

SPECI  OTIS  281323Z - TSB25 

This  is  rather  contradictory.  The  observation  was  taken  at  23 
minutes  past  the  hour  and  yet  it  indicates  that  the 
Thunderstorm  began  at  25  minutes  past  the  hour. 

This  is  a  critical  problem  since  credibility  of  the  information 
will  be  raised  by  the  users  with  such  a  contradiction. 

DME  needs  to  fix  the  software  so  that  the  correct  time  is  used 
for  Thunderstorm  Begin/End  remarks. 

1 1/25/97 -DGG 

At  PMR  it  was  confirmed  that  this  PTR  would  be  addressed 
by  DME  in  build  4.19. 

2/24/98  -  DGG 

Data  from  OT&E  #2  al-02c-l.cap  verifies  that  the  time 
stamps  are  synchronized,  therefore  this  PTR  is  closed. 
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PTR  # 

PTR  Title 

PTR  Open 
PTR  Accepted 
Discover  Date 

Failure  Category 
Criticality 
Originator 
Location 
Software  Version 
Related  PTRs 

Affected  Reqs 

Discrepancy 

Discription 


Recommendation 

Action  Taken 
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OTE-013 

Delayed  LAD  Message  Generation 


9/2/97 

Software 

Major 

Groot 

ADAS  PSF 
4.18 


ADAS  Spec  3.1.4.2.3.2 

During  analysis  of  data  for  test  AL-09  (run  4)  a  delay  in  the 
generation  of  the  LAD  message  was  discovered.  Review  of 
the  NLDN  data  (using  the  Flash  Retrieve  option  on  the 
NLDN  system)  indicated  that  a  single  flash  within  the  0  -  5 
nm  area  around  the  AWOS  occurred  at  14:50:46.  How'ever, 
the  corresponding  LAD  message  was  not  generated  until 
14:52:02  (as  indicated  in  the  IPS  AWOS  LAD  message  file). 
This  violates  the  requirement  in  ADAS  Spec  3. 1.4. 2. 3.2 
which  states  "lightning  activity  data  stored  for  the  previous 
elapsed  minute  shall  be  processed  during  a  distinct. 

synchronous  phase  of  the  ADAS  1 -minute  clock  cycle. - 

SLAP  processing  shall  consist  of  —  construction  of  exactly 
one  LAD  message  per  minute  every’  minute  for  each  AWOS 
currently  configured—." 

Note:  At  the  beginning  of  this  test,  the  IPS  and  ADAS  clocks 
were  synchronized  to  the  NLDN  system  time. 

DME  needs  to  investigate  why  lightning  data  is  not  processed 
according  to  this  requirement. 

9/2/97  DGG 

This  PTR  was  closed.  After  conversation  with  GAI  folks,  1 
learned  that  although  a  flash  is  marked  with  the  time  the  flash 
occurred,  the  NLDN  display  (and  ADAS)  does  not  receive 
the  LDD  until  approximately  30  seconds  later.  As  a  result, 
ADAS  didn't  get  the  flash  from  14:50:46  until  approx. 
14:51:26  and  therefore  the  LAD  from  14:52:02  would  be 
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PTR# 

OTE-014 

PTR  Title 

Event  type  49  Notification 

PTR  Open 

y 

PTR  Accepted 

y 

Discover  Date 

09/02/97 

Failure  Category 

Software 

Criticality 

Moderate 

Originator 

Stratton 

Location 

ADAS  PSF 

Software  Version 

4.18/3.12 

Test  OP- 13  (Normal  Event  Logging)  is  designed  to  trigger 
multiple  event  types  21  &  49.  An  event  log  report  for  event 
type  49  returned  a  failure  response  indicating  the  Event  Log 
contained  no  event  type  49  entries.  ADAS  should  trigger  an 
event  type  49  every  time  it  generates  a  SPECI  message.  Test 
data  shows  ADAS  generated  9  SPEC!  msgs  during  the  test.  8 
of  which  were  generated  prior  to  the  event  log  report  request. 

1  1Nov97  DME  indicated  the  s/w  was  change  to  not  record  an 
event  type  49  after  discussions  with  John  Winkler. 

Recommendation  DME  needs  to  analyze  error  and  update  the  software. 

ACT-320  should  be  provide  with  documentation  authorizing 
event  type  49's  no  longer  be  trigger. 

2/27/98  -  DGG/JKS 

Upon  further  investigation  of  this  PTR  and  with  consultation 
with  AOS-500,  ACT-320  recommends  that  this  PTR  be 
reopened  since: 

1)  There  is  no  explicit  requirement  in  the  ADAS  Spec  to 
not  include  METAR  message  generation  as  an  event  in  the 
event  log; 

2)  ADAS  System  Specification  (FAA-E-2804  rev.  D) 
paragraph  3. 1.4.3. 1.3  Implicitly  implies  that  Metar  message 
generation  should  generate  and  log  an  event  into  the  System 
Event  Log; 

3)  AOS-500  believes  that  instead  of  permanently  disabling 
event  type  49  generation,  the  addition  of  a  single-bit  field  to 
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Affected  Reqs 

Discrepancy 

Discription 
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the  adaptation  database  event_type  record  to  provide  the 
ability  to  enable/disable  the  generation/logging  of  each  event 
type  individually  would  allow  AOS  to  enable  event  type  49 
event  generation  as  needed  for  field  support.  An  enable 
disable  bit  would  also  allow  the  disabling  of  other  high 
frequency  events  (such  as  15,  35,  or  36). 

4/9/98  -  DGG 

On  4/7/98  telecon  with  AUA,  AOS  and  ACT  it  was  decided 
that  ADAS  should  record  event  type  49. 

It  was  agreed  by  AOS,  AUA  and  ACT  during  telcon  on  4/8 
that  AOS  would  take  care  of  implementing  this  software 
change  and  any  necessary  documentation  changes.  AOS  was 
planning  to  implement  this  as  part  of  the  Deployment  ADAS 
build  on  4/23/98. 

Action  Taken  11/26/97  -  DGG 

DME  PCR  #266  was  written  and  indicates  that  they  were 
directed  to  remove  the  logging  of  event  type  49  because  there 
is  no  requirement  for  this  event  type  to  be  logged.  This  PTR 
is  closed.  See  attached  PCR. 

2/27/98  -  DDG  /  JKS  ####  PTR  Re-OPENED  #### 

PTR  Re-OPENED:  Examination  of  the  ADAS  System 
Specification  (FAA-E-2804  rev.  D)  ,with  respect  to  system 
event  logging  (para.  3. 1.4. 3. 1.3).  indicates  that  AUA  &  DME 
are  correct  in  stating  there  is  no  explicit  requirement  to 
generate  event  type  49  (et49)  events,  the  system  logging 
paragraph  implicitly  et49  event  generation  and  logging. 

Notes 
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OTE-015 

Missing  xxxNO  Remarks  in  SPECIs 

y 

y 

9/1 1/97 

Documentation 
Moderate 
AU  A 
Ken  Kraus 
4.18 


ADAS/AWOS  ICD  Par  90.2.4 

Upon  analysis  of  Metar  data  from  8/21  to  8/25/97  (filename 
OTISARC.W5 1 )  Ken  Kraus  found  that  in  the  remarks 
section  RWINO  FZRNO  and  RVRNO  were  generated  for 
AOl  sites.  However,  these  remarks  only  appeared  in 
METARs  not  SPECIs.  According  to  ICD  these  "xxxNO" 
remarks  should  be  included  in  both  METARs  and  SPECIs. 

Another  aspect  of  this  PTR  is  whether  the  "xxxNO"  remarks 
were  correctly  being  generated.  The  AWOS  format  messages 
will  have  to  be  analyzed  to  determine  if  the  proper  fields/bits 
were  set  in  order  to  justify  these  remarks  in  the  Metars. 

DME  needs  to  incorporate  these  remarks  for  SPECIs  as  well 
as  METAR  messages.  (Or  possibly,  based  on  investigation 
of  AWOS  format  messages,  the  METAR  should  not  have 
included  these  "xxxNO"  remarks.) 

1 1/07/97  DGG 

Based  on  conversations  on  10/16/97  with  AUA,  DME  and 
TSC,  AUA  needs  to  work  with  John  Winkler  to  update  the 
ICD. 

1 1/25/97  -  DGG 

At  PMR  it  was  confirmed  that  this  PTR  would  be  addressed 
by  DME  in  build  4.19. 

2/25/98  -  DGG 

Based  on  tests  performed  by  DME  at  DT&E  #2  this  PTR  has 
been  verified  as  corrected  and  therefore  the  PTR  is  closed. 


B-28 


AT, PARS  PTR  DETAILED  REPORT  -  ALL 


4/9/98  -  DGG 

This  PTR  was  reopened.  This  was  based  on  changes  made  to 
the  ADAS/AWOS  ICD.  These  changes  will  result  in  AWOS 
AOl  type  stations  to  not  generate  PWINO,  FZRNO,  and 
RVRNO  remarks.  The  following  ICD  par  were  changed 
90.2.4.3.8.,  .9,  .11;  90.3.2. 12. 1.1.A.2;  90.3.2.12.3.8,  .9,  .1 1 

Notes 
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OTE-016 

DISPLAY  ITWS  COMM.  CHAR. 

Z 

Z 

9/12/97 

Software 

Moderate 

Vuong 

ADAS  PSF 

4.18 


The  ITWS  SI  screen,  "Display  ITWS  communications  LU 
Datapoints",  does  not  indicate  the  ITWS  site  number.  It  is 
confusing  to  a  specialist  operator  who  analyzes  the  data. 

DME  needs  to  modify  the  display  to  include  the  site  number 
for  ITWS(s). 

11/7/97  HHV 

AUA  needs  to  create  a  requirement  for  DME  implementation. 
1 1/26/97 -DGG 

At  the  PMR  DME  agreed  that  they  would  fix  this  problem  for 
the  Y2K  build.  The  fix  will  be  similar  to  the  fix  necessary 
for  the  AWOS  SI  screen  problem,  i.e..  they  will  include  the 
ITWS  #  on  the  SI  display. 
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OTE-017 

SI  crashes  when  trying  to  view  restored  maintenance  log  data. 

V 

9/14/97 

Software 

Moderate 

Stratton 

ADAS  PSF 

4.12/3.18 

OTE-018 


During  the  ADAS/ALDARS  OT&E/Regression  Test 
FORMAL  TEST  RUN  (FTR)  of  DT&E  Test  180  (D25-01), 
the  Specialist  Interface  crashed  when  a  "Display  Restored 
Maintenance  Data"  request  is  made,  with  the  ASC  displaying 
"C-scape:  Error  Number  74  in  menu.Printf()9."  followed  by  a 
login  prompt.  [NOTE:  The  data  entered  in  Steps  4.1.27.6.15 
&  16  was  not  identical  to  the  data  to  be  entered  indicated 
within  those  steps.  A  variation  of  data  entered  should  not 
cause  the  SI  to  crash  unless  there  is  a  serious  problem  with 
the  ADAS  SI  code  and/or  the  C-scape  utilities  ] 

JKS  1  1Nov97  -  Test  180  was  re-run  without  the  error 
occurring.  ACT-320  has  been  unable  to  reproduce  the  error 
under  any  circumstances. 

DME  needs  to  det'm  the  cause  of  the  C-scape  error  and 
encode  an  error  handling  routine  into  the  SI  software.  (Not 
Reproducible) 

JKS  1  1Nov97  -  AOS  shall  be  alerted  to  the  singular 
occurrence  of  this  problem  during  OT&E,  and  be  advised  by 
ACT  to  be  alert  for  possible  future  occurrences.  The  problem 
cannot  be  identified  until  it  can  be  reliably  reproduced. 

1 1/26/97 -DGG 

Since  this  PTR  could  not  be  repeated  it  has  been  closed. 

AOS  has  been  notified  of  this  anomaly. 

See  PTR  OTE-018  "Notes"  block. 
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OTE-018 

Specialist  unable  to  Login  to  SI  at  ASC. 

5 

9/14/97 

Software 

Moderate 

Stratton 

ADAS  PSF 

4.18/3.12 

OTE-017 


During  the  ADAS/ALDARS  OT&E/Regression  Test 
FORMAL  TEST  RUN  (FTR)  of  DT&E  Test  180  (D25-01). 
the  Specialist  Interface  crashed  when  a  "Display  Restored 
Maintenance  Data"  request  is  made,  with  the  ASC  displaying 
"C-scape:  Error  Number  74  in  menu.Printf()9."  followed  by  a 
login  prompt.  If  the  specialist  logs  back  in  and  re-issues  the 
request,  the  SI  crashes  again,  displays  the  same  error 
followed  by  the  login  prompt,  but  the  specialist  is  unable  to 
log  back  in  to  the  SI  unless  a  process  was  killed  to  induce  an 
ADAS  auto-restart.  (As  the  value  of  the  Test  Cfg  adb 
variable  "Max  Specialists"  was  set  to  2,  it  seems  ADAS 
incremented  the  #  of  specialists  logged  in  properly,  but  failed 
to  note  the  SI  crash  and  did  not  decrement  the  value,  causing 
the  specialists  inability  to  login  after  the  2nd  crashing  of  the 
SI.) 

JKS  1  1Nov97  -  Test  180  was  re-run  and  the  problem  did  not 
occur.  ACT  has  been  unable  to  reproduce  this  problem  under 
any  circumstances.  This  problem  cannot  be  defined,  let  alone 
fixed,  unless  it  is  reproducible. 

DME  needs  to  det'm  why  the  specialist  cannot  login  and 
correct  the  software  as  needed.  (Not  Reproducible) 

JKS  1  1Nov97  -  AOS  shall  be  alerted  to  the  singular 
occurrence  of  this  problem  during  OT&E,  and  be  advised  by 
ACT  to  be  alert  for  possible  future  occurrences.  The  problem 
cannot  be  identified  until  it  can  be  reliably  reproduced. 
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1 1/26/97  -  DGG 

Since  this  PTR  could  not  be  repeated  it  has  been  closed. 

AOS  has  been  notified  of  this  anomaly. 

PTR  data  collected  on  the  ADAS: 

grabbed  $1/*.  $d/MP/ludp.wf  Sd/SL/T  $d/WD/T  Sd/WS/*, 
$d/LHT/* 

prior  to  inducing  a  re-start  (’Setlog  40'  command  issued  prior 
to  restart):  after  the  restart;  after  the  1st  crash;  and  again  after 
the  2nd  crash  (Same  state  as  prior  to  restart.) 
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PTR  #  OTE-019 

PTR  Title  Erroneous  WSHIFT  Remarks 

PTR  Open  L_ 

PTR  Accepted  ^ 

Discover  Date  9/16/97 

Failure  Category  Software 

Criticality  Moderate 

Originator  AUA 

Location  Ken  Kraus 


Software  Version  4.18 

Related  PTRs  OTE-020 


Affected  Reqs 

Discrepancy 

Discription 


Recommendation 


ADAS/A WOS  ICD  par  90.2.3.2.5 

Paragraph  90.2.3.2.5  of  the  ADAS/A  WOS  ICD  states  that 
two  of  the  criteria  for  a  wind  shift  are  if  the  current  wind 
direction  and  previous  wind  direction  are  45  degrees  or  more 
apart  and  that  all  AWOS  average  wind  speeds  for  the  past  15 
minutes  are  10  or  more  knots.  Examination  of  the  data  for 
OTIS  AWOS  SPECIs  on  8/30  indicate  that  these  criteria  were 
not  met.  The  times  where  the  problem  was  observed  are 
1613,  1615,  1618,  1623,  1626,  1629,  1634,  etc.  The  data  has 
been  saved  in  a  file  named  otis-ptr.doc, 

DME  needs  to  fix  the  software  to  correctly  report  wind  shifts. 


Action  Taken  9-29-97  DGG 

This  PTR  has  been  closed  since  the  ADAS  configuration  file 
had  been  set  to  6  knots  or  less  for  WSHIFT  Remarks. 
Therefore  the  WSHIFT  remarks  were  correct. 

Notes  File  otis-ptr.doc  contains  the  data  to  support  this  PTR. 
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OTE-020 

Erroneous  "WSHIFT  -2"  Remark 


V 

9/16/97 

Software 

Moderate 

AUA 

Ken  Kraus 
4.18 

OTE-019 

ADAS/AWOS  ICD  par  90.3.2.12.1.2.3 

During  examination  of  8/30/97  OTIS  data,  at  201 1  and  2058 
the  remark  "WSHIFT  -2"  was  reported.  This  is  not  in 
accordance  with  the  ICD  paragraph  noted  above. 

DME  needs  to  investigate  why  this  erroneous  wind  shift 
remark  was  generated 

1 1/25/97 -DGG 

At  PMR  it  was  confirmed  that  this  PTR  would  be  addressed 
by  DME  in  build  4.19. 

2/25/98  -  DGG 

Based  on  tests  performed  by  DME  at  DT&E  #2  this  PTR  has 
been  verified  as  corrected  and  therefore  the  PTR  is  closed. 

File  otis-ptr.doc  contains  the  support  data  for  this  PTR. 
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OTE-021  - 

ASOS  SPECI  generation  for  thunderstorm 


V 

9/16/97 

Documentation 

Moderate 

Groot 

ADAS  PSF 
4.18 


ADAS/A WOS  IGD: 
par  90.3.2.12.1.5.3 
par  10.3.15.1 

Review  of  the  ASOS  SPECI  messages  indicated  that  the 
SPECI  message  generated  as  a  result  of  a  simulated 
thunderstorm  did  not  correspond  to  the  LAD  messages  sent 
by  ADAS.  Discussions  with  SMI  engineer  revealed  that 
ASOS  waits  an  adaptable  amount  of  time  (between  2  and  6 
minutes)  before  submitting  a  SPECI.  ADAS/A  WOS  ICD 
par  10.3.15.1  states  that  the  ASOS  is  exempt  from  using 
Octet  57,  Bit  0  to  determine  if  there  is  to  be  generation  of  a 
SPECI  message  and  that  the  ASOS  can  make  its  own 
determination  as  to  when  to  generate  a  SPECI.  Further,  par 
90. 1 . 1  states  that  ASOS  is  exempt  from  the  SPECI  and 
METAR  generation  criteria  outlined  in  the  ADAS/A  WOS 
ICD  section  90.  This  creates  a  contradiction  in  the  criteria 
used  to  generate  SPECIs  and  METARs  for  AWOS  and 
ASOS.  This  represents  an  operational  risk  since  a  SPECI  and 
METAR  message  can  have  different  meaning  depending  on 
the  site  (i.e..  whether  AWOS  or  ASOS).  As  discovered 
during  OT&E  the  exact  same  information  sent  to  a  live 
AWOS  and  live  ASOS  results  in  different  METAR  and 
SPECI  messages  being  generated. 

However,  no  where  is  the  criteria  defined  for  ASOS  SPECI 
generation.  In  fact,  contradictions  occur  later  in  the 
document  when  in  par.  90.3.2.12.1.5.3  the  ICD  indicates  that 
"Table  90-6  also  indicates  when  special  reports  (SPECI)  are 
generated  because  the  begin/end  of  these  conditions  are 
considered  critical  weather  events."  Examination  of  Table 
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90-6  reveals  that  TSBxx  and  TSExx  are  considered  "critical 
weather  events"  and  as  a  result  ASOS  should  generate  a 
SPECI  when  the  source  data  (Octet  57,  bits  6  and  7  and  Octet 
58,  bits  0  through  7)  indicates  lightning  activity. 

There  needs  to  be  consistent,  equal  criteria  established  for  the 
generation  of  METAR  and  SPECI  messages  for  the  ASOSs 
and  AWOSs. 

10-1-97  DGG 

This  PTR  was  closed  since  PTR  OTE-029  was  more 
complete  in  describing  the  problem. 

File  al-02b-2.cap  contains  the  data  to  support  this  PTR. 
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OTE-022 

Erroneous  PRESFR/PRESRR  Remark 

V 

5 

9/16/97 

Software 

Major 

AUA 

Ken  Kraus 
4.18 

OTE-023 

ADAS/AWOS  ICD 
par  90.2.4.1.6 

Examination  of  8/21/97  OTIS  data  at  1658,  1858,  1959, 

2058,  etc.  indicated  a  Pressure  Falling  Rapidly  (PRESFR) 
remark.  Data  for  8/22/97  at  0958  indicated  a  Pressure  Rising 
Rapidly  (PRESRR)  remark.  However,  the  criteria  of  a 
pressure  change  of  more  than  0.025  inHg  was  not  attained  for 
these  remarks. 

DME  needs  to  fix  the  code  to  correctly  determine  a 
PRESFR/PRESRR  condition. 

1 1/07/97  DGG 

AUA  &  TSC  still  need  to  investigate  this  problem  to 
determine  if  it  needs  to  be  corrected. 

11/26/97 -DGG 

This  PTR  was  upgraded  to  major  at  the  PMR.  It  was 
determined  that  since  it  was  still  uncertain  what  the  problem 
was  and  that  there  was  question  about  the  Federal  Standard 
Algorithms  that  were  used,  that  the  PRESRR  and  PRESFR 
should  be  removed  from  build  4.19.  This  will  require  DME 
to  remove  from  the  software.  The  FAA  will  continue  to 
investigate  how  this  should  be  implemented  for  the  Y2K 
build. 

2/25/98  -DGG 

This  PTR  was  addressed  in  Build  4. 19  as  stated  in  the 
recommendation  section  by  eliminating  the  PRESRR  and 
PRESFR  from  the  remarks.  This  was  tested  at  DT&E  #2  and 
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was  found  to  be  implemented  correctly.  However,  the  PTR 
will  not  be  closed  pending  the  final  solution  as  dictated  by 
AUA  decision.  The  AUA  decision  will  be  implemented  in 
the  Y2K  Build. 

4/9/98  -  DGG 

During  the  ACT,  AUA,  AOS  telecon  on  4/8,  Joe  Gibson 
informed  ACT  that  the  appropriate  algorithm  necessary  for 
PRESFR/PRESRR  remarks  had  not  been  identified. 
Therefore,  the  resolution  of  this  PTR  was  yet  to  be 
determined. 

N0tes  The  file  otis-ptr.doc  contains  the  data  to  support  this  PTR. 

9/18/97  DGG 

Talked  to  John  Winkler.  He  stated  that  you  need  to  look  at 
previous  80  minutes  of  data  to  make  this  determination  since 
PRESRR  and  PRESFR  remarks  only  come  out  with  hourly 
METAR  (even  if  METARs  are  scheduled  less  than  every 
hour).  Although  PTR  is  not  closed  it  is  uncertain  if  it  is 
valid  at  this  time. 
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PTR# 

OTE-023 

PTR  Title 

Erroneous  Ceiling  SPECIs 

PTR  Open 

i  i 

PTR  Accepted 

S 

Discover  Date 

9/17/97 

Failure  Category 

Software 

Criticality 

Moderate 

Originator 

AUA 

Location 

Pete  Kirchoffer 

Software  Version 

4.18 

Related  PTRs 

Affected  Reqs 

ADAS/AWOS  ICD 
par  90.2.3.2.1 

Discrepancy 

Discription 

Examination  of  8/30/97  OTIS  data  revealed  a  number  of 
Ceiling  SPECIs  that  were  erroneously  reported.  These 
SPECIs  did  not  meet  the  criteria  as  defined  in  ADAS/AWOS 
ICD  par  90.2.3.2.1. 

Recommendation 

DME  needs  to  fix  the  software  so  that  Ceiling  SPECIs  are 
only  generated  for  the  defined  requirements. 

Action  Taken 

9/18/97  DGG 

John  Winkler  gave  clarification  that  because  of  settings  in 
config  file  82  these  SPECIs  were  valid.  Therefore  PTR  was 
closed. 


Notes  Pete  Kirchoffer  sent  to  ACT-320  3  pages  of  "marked  up" 

Metar  messages.  These  "marked  up"  pages  indicate  which 
SPECIs  were  incorrectly  generated.  These  pages  are  on  file 
with  ACT-320.  The  3  pages  cover  a  time  frame  from  300158 
to  301221.  The  data  for  this  time  frame  are  stored  in  file 
Otis7i01.w51. 
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OTE-024 

Erroneous  Visibility  SPECIs 

V 

9/17/97 

Software 

Moderate 

AUA 

Pete  Kirchoffer 
4.18 


ADAS/AWOS  ICD 
par  90.2.3.2.3 

Examination  of  8/30/97  OTIS  data  revealed  a  number  of 
Visibility  SPECIs  that  were  erroneously  reported.  These 
SPECIs  did  not  meet  the  criteria  as  defined  in  ADAS/AWOS 
ICD  par  90.2.3.2.3. 

DME  needs  to  fix  the  software  so  that  Visibility  SPECIs  are 
only  generated  for  the  defined  requirements. 

9/18/97  DGG 

John  Winkler  gave  clarification  that  because  of  settings  in 
config  file  82  these  SPECIs  were  valid.  Therefore  PTR  was 
closed. 

Pete  Kirchoffer  sent  to  ACT-320  3  pages  of'marked  up" 
Metar  messages.  These  "marked  up"  pages  indicate  which 
SPECIs  were  incorrectly  generated.  These  pages  are  on  file 
with  ACT-320.  The  3  pages  cover  a  time  frame  from  300158 
to  301221.  The  data  for  this  time  frame  are  stored  in  file 
Otis7i01.w51. 
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PTR  DETAILED  REPORT  -  AT  T, 

OTE-025 

Missed  Zone  1  strikes 


V 

9/19/97 

Software 

Major 

Groot 

ADAS  PSF 

4.18 

OTE-026  and  OTE-027 

ADAS  Spec 
par  3.1.4.2.3.1.3(c) 

Test  AL-02A.  Analysis  of  LAD  messages  for  this  test 
revealed  that  lightning  strikes,  at  minutes  34  and  50,  located 
5nm  and  direction  270  degrees  from  ARP  did  not  result  in  the 
Zone  1  bit  being  set.  However,  lightning  strikes,  at  minutes 
66  and  82,  located  at  5nm  and  direction  0  degrees  from  ARP 
and  a  lightning  strike,  at  minute  98,  located  5nm  and 
direction  90  degrees  from  ARP  did  result  in  the  Zone  1  bit 
being  set. 

DME  needs  to  investigate  why  these  Zone  1  lightning  strikes 
did  not  get  processed  properly. 

1 1/07/97  DGG 

Based  on  10/16/97  tel  con,  DME  will  investigate  to  ensure 
that  this  is  a  precision  problem  and  nothing  more.  If  it  is 
only  a  precision  related  problem,  then  this  PTR  will  be  closed. 

1 1/26/97  -  DGG 

DME  provided  data  to  show  that  this  problem  is  a  small 
rounding  error  that  at  certain  directions  causes  lightning  to  be 
calculated  as  falling  just  outside  of  the  zone/sector  that  the 
IPS  script  file  indicates.  Therefore  this  PTR  is  closed.  (See 
attached  data) 
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OTE-026 

Missed  Zone  2  strikes 


✓ 

9/19/97 

Software 

Major 

Groot 

ADAS  PSF 
4.18 

OTE-025  and  OTE-027 

ADAS  Spec 
par  3.1.4.2.3.1.3(c) 

Test  AL-02A.  Analysis  of  LAD  messages  for  this  test 
revealed  that  lightning  strikes,  at  minutes  66  and  82,  located 
lOnm  and  direction  270  degrees  from  ARP  did  not  result  in 
the  Zone  2  bit  being  set.  However,  lightning  strikes,  at 
minutes  34  and  50,  located  at  lOnm  and  direction  180 
degrees  from  ARP  and  a  lightning  strike,  at  minute  98, 
located  lOnm  and  direction  0  degrees  from  ARP  did  result  in 
the  Zone  2  bit  being  set. 

DME  needs  to  investigate  why  these  Zone  2  lightning  strikes 
did  not  get  processed  properly. 

11/07/97  DGG 

Based  on  10/16/97  tel  con,  DME  will  investigate  to  ensure 
that  this  is  a  precision  problem  and  nothing  more.  If  it  is 
only  a  precision  related  problem,  then  this  PTR  will  be  closed. 

1 1/26/97  -  DGG 

DME  provided  data  to  show  that  this  problem  is  a  small 
rounding  error  that  at  certain  directions  causes  lightning  to  be 
calculated  as  falling  just  outside  of  the  zone/sector  that  the 
IPS  script  file  indicates.  Therefore  this  PTR  is  closed.  (See 
attached  data) 


Notes 
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PTR# 

OTE-027 

PTR  Title 

Missed  Zone  3  strikes 

PTR  Open 

□ 

PTR  Accepted 

Z 

Discover  Date 

9/19/97 

Failure  Category 

Software 

Criticality 

Major 

Originator 

Groot 

Location 

ADAS  PSF 

Software  Version 

4.18 

Related  PTRs 

OTE-025  and  OTE-026 

Affected  Reqs 

ADAS  Spec 
par  3.1.4.2.3.1.3(d) 

Discrepancy 

Discription 

Test  AL-02A.  Analysis  of  LAD  messages  for  this  test 
revealed  that  lightning  strikes,  at  minutes  50  and  82,  located 
30nm  and  at  directions  22,  1 12,  1 13,  157,  202,  203,  247,  248, 
337,  and  338  degrees  from  ARP  did  not  result  in  the 
appropriate  Zone  3  sector  bits  being  set.  However,  lightning 
strikes,  at  these  same  minutes,  located  at  30nm  and  directions 
23,  67,  68,  158,  292,  and  293  degrees  from  ARP  did  result  in 
the  appropriate  Zone  3  sector  bits  being  set. 

Recommendation 

DME  needs  to  investigate  why  these  Zone  3  lightning  strikes 
did  not  get  processed  properly. 

1 1/07/97  DGG 

Based  on  10/16/97  tel  con,  DME  will  investigate  to  ensure 
that  this  is  a  precision  problem  and  nothing  more.  If  it  is 
only  a  precision  related  problem,  then  this  PTR  will  be  closed. 

Action  Taken 

1 1/26/97  -  DGG 

DME  provided  data  to  show  that  this  problem  is  a  small 

Notes 

rounding  error  that  at  certain  directions  causes  lightning  to  be 
calculated  as  falling  just  outside  of  the  zone/sector  that  the 

IPS  script  file  indicates.  Therefore  this  PTR  is  closed.  (See 
attached  data) 
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OTE-028 

ASOS  1 5  Minute  Persistence 


V 

9/29/97 
Other 
Critical 
Groot 
ADAS  PSF 
ASOS  ver  ??? 


Analysis  of  ADAS/ASOS  test  AL-02C  revealed  that  the 
ASOS  maintains  a  15  minute  buffer  for  lightning 
independent  of  ADAS.  The  result  was  that  when  actual 
lightning  strikes  ceased  and  the  ADAS  continued  to  send 
LADs  indicating  "persistence  strikes".  ASOS  treated  these 
"persistence  strikes"  as  "actual  strikes".  Therefore,  when  the 
ADAS  15  minute  persistence  ended,  ASOS  then  started  their 
persistence  timer  and  continued  to  reflect  lightning  in  the 
OMOs  and  Metar  messages  for  an  additional  1 5  minutes. 

Discussions  have  already  occurred  between  ACT-320,  NWS 
and  SMI.  SMI  plans  to  have  fixed  the  ASOS  software 
sometime  in  October. 

10/22/97  DGG 
This  PTR  is  closed. 

Test  run  AL-02C-4  indicated  that  this  problem  had  been 
corrected  in  the  ASOS  software  by  SMI.  However,  with  the 
resolution  of  this  problem  another  problem  was  discovered 
and  is  recorded  in  PTR  OTE-037. 
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OTE-029 

Discrepancies  in  Metar  Message  Generation  Criteria 

Z 

Z 

9/29/97 
Software 
Moderate 
Groot 
ADAS  PSF 


Analysis  of  live  ADAS/ASOS/AWOS  testing  revealed  that 
there  are  discrepancies  between  the  way  the  AWOSs  and 
ASOSs  generate  Metar  messages.  The  following  are  two 
known  discrepancies  that  exist: 

1.  ASOS  does  not  generate  TSBxx/TSExx  for  lightning 
outside  of  10  nm.  AWOS  does  (Note:  even  after  the 
proposed  changes  are  made  to  ADAS,  for  no  SPECIs  outside 
of  lOnm,  it  does  not  appear  that  the  issuance  of  <10nm  to 
30nm  TSBxx/TSExx  remarks  has  been  addressed). 

2.  ASOS  generates  SPECIs  at  a  site  specific  amount  of 
minutes  once  a  LAD  is  received  indicating  lightning  from  0 
to  10  nm.  ADAS  generates  SPECIs  immediately  when  the 
OMO  from  AWOS  indicates  the  SPECI  bit  is  set. 

The  problem  lies  in  the  ADAS/AWOS  ICD  paragraphs 
10.3.15.1  and  90.1.1  which  allows  ASOS  to  set  their  "own 
rules”  for  METAR  and  SPECI  message  and  TSBxx/TSExx 
remarks  generation.  This  represents  an  operational  risk  since 
SPECI  and  METAR  messages  can  have  different  meaning 
depending  on  the  site  (i.e..  whether  AWOS  or  ASOS).  As 
discovered  during  OT&E  the  exact  same  information  sent  to 
a  live  AWOS  and  live  ASOS  results  in  different  METAR  and 
SPECI  messages  being  generated. 

These  discrepancies  need  to  be  resolved  and  consistent 
criteria  established  so  that  all  sites  (AWOS  and  ASOS)  will 
generate  METAR  and  SPECI  messages  and  TSBxx/TSExx 
remarks  under  the  same  conditions.  At  present,  the  differing 
criteria  pose  an  operational  risk  since  METAR/SPECI 
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AT.PARS  PTR  DETAILED  REPORT  -  ALL 


Action  Taken 


Notes 


generation  and  TSBxx/TSExx  remarks  have  different 
meanings  depending  on  the  type  of  site. 

1 1/07/97  DGG 

AUA  has  the  action  to  determine  how  to  handle  discrepancy 
1.  above.  As  the  current  ICD  changes  stand,  this  issue  is  not 
being  addressed. 

1 1/26/97  -  DGG 

At  the  PMR  it  was  determined  that  AUA  needs  to  update  the 
ICD  to  have  TSB/TSE  only  issued  for  strikes  in  the  0  -  10  nm 
range.  Once  this  change  is  made  DME  will  be  directed  to 
make  the  necessary  software  changes  (for  the  Y2K  build)  to 
reflect  these  ICD  changes. 

11/26/97 -DGG 

For  item  2.  AUA  indicated  that  this  discrepancy  is  not  a 
problem  and  no  action  needs  to  be  taken. 

2/25/98  -  DGG 

Item  1.  still  remains  open  and  AUA  needs  to  modify  the  ICD 
and  then  direct  DME  what  changes  to  make  for  the  Y2K 
build. 

4/9/98  -  DGG 

AUA  has  made  the  appropriate  ICD  change  to  section 
90.3.2.12.1.5.2.  DME  will  be  directed  to  make  the  software 
changes  for  the  Y2K  build. 
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OTE-030 

AWOS  Station  LAD  Enable  Edit  Adaptation  Error 

V 

9/29/97 

Software 

Critical 

Groot 

ADAS  PSF 
4.18 

DME  PCR  285 
PTR  OTE-007 


While  performing  live  ADAS/ASOS  testing,  tried  to  EDIT 
and  INSTALL  changes  to  the  LAD  Enable/Disable  for  the 
live  ASOS,  KSMI.  These  changes  did  not  take  affect, 
although  with  both  EDIT  and  INSTALL  screen  displayed 
"success". 

DME  needs  to  fix  this  problem  so  that  all  AWOS/ ASOS 
EDIT  and  INSTALL  options  work  properly. 

1 1/25/97  -  DGG 

At  PMR  it  was  confirmed  that  this  PTR  would  be  addressed 
by  DME  in  build  4,19. 

2/24/98  DGG 

This  PTR  was  verified  as  fixed  during  tests  for  AL-09, 
therefore  this  PTR  is  closed. 
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PTR# 

OTE-031 

PTR  Title 

Missing  "LTG  DATA  MISG"  Remark 

PTR  Open 

PTR  Accepted 

y 

Discover  Date 

9/30/97 

Failure  Category 

Software 

Criticality 

Major 

Originator 

Groot 

Location 

ADAS  PSF 

Software  Version 

4.18 

Related  PTRs 

OTE-008 

ADAS/A WOS  ICD 
Par  90.3.2.12.1.4.2 

Analysis  of  data  for  test  AL-08  revealed  that  the  LTG  DATA 
MISG  remark  was  not  incorporated  into  the  METAR 
message.  At  13:3 1  the  cable  to  the  NLDN  controller  was 
disconnected.  At  13:44  the  OTIS  OMO  included  a  LTG 
DATA  MISG  remark  in  Field  22  and  Field  21  (Octet  68).  bit 
3  was  also  set.  OTIS  continued  to  send  this  remark  in  each 
OMO  up  to  and  including  the  14:04  OMO.  However,  the 
METAR  at  14:00  did  not  include  the  LTG  DATA  MISG 
remark.  This  is  in  violation  of  ADAS/AWOS  ICD  Par 
90.3.2.12.1.4.2. 

1 1/05/97  DGG 

This  problem  is  probably  the  same  problem  that  is  causing 
OTE-008.  The  LTG  DATA  MISG  remark  is  listed  in  the 
DLP  AWOS  file  under  OPERATOR  REMARKS  but  it  has 
the  "1"  after  it  so  that  would  constitute  ADAS  interpreting  as 
an  AUTOMATED  REMARK.  This  would  make  it  necessary 
for  DME  to  fix  not  AWOS. 

11/25/97 -DGG 

The  problem  is  that  a  space  has  been  added  to  the  automated 
lightning  remarks  and  therefore  when  ADAS  code  checks  oct 
69  and  finds  it  blank  it  assumes  no  auto  remarks. 

Recommendation  DME  needs  to  fix  software  to  include  LTG  DATA  MISG  in 
the  remarks  field. 

11/07/97  DGG 


Affected  Reqs 

Discrepancy 

Discription 
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As  described  above  this  is  probably  a  ADAS  problem  not  an 
AWOS  problem  and  therefore  DME  needs  to  provide  a  fix. 

1 1/25/97  -  DGG 

Although  the  problem  resides  with  the  AWOS  adding  in  a 
blank  space  at  oct  69,  the  solution  will  be  to  update  the  ICD 
and  then  have  DME  change  code  to  allow  for  blank  space  in 
oct  69  but  still  get  the  auto  lightning  remarks.  This  will  be 
addressed  in  build  4. 1 9. 

Action  Taken  2/24/98  -  DGG 

Data  from  OTE  #2  al-02c-l.cap  verifies  that  OTIS  remarks 
are  in  the  SPECIs,  therefore  this  PTR  is  closed. 

4/9/98 -DGG 

ICD  par  10.3.20  was  modified  to  complete  the  resolution  of 
this  PTR. 

Notes 
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OTE-032 

No  TSEmm  After  The  Hour 


V 

9/30/97 

Software 

Major 

Groot 

ADAS  PSF 

4.18 

OTE-010 

ADAS/AWOS  ICD 

Par  90.3.2.12.1.5.3,  Table  90-6 

During  AL-xx  tests,  when  there  was  a  TSBmm  that  began 
before  the  hour  and  ended  after  the  hour  a  TSBhhmmTSEmm 
was  not  generated. 

Test  AL-02C  has  some  specific  cases  of  this  problem. 

DME  needs  to  fix  the  software  to  properly  generate  this 
remark. 

1 1/25/97 -DGG 

At  PMR  it  was  confirmed  that  this  PTR  would  be  addressed 
by  DME  in  build  4.19. 

2/24/98  -  DGG 

This  PTR  was  fixed  as  verified  by  data  in  al-02c-l.cap  and 
therefore  this  PTR  is  closed.  However,  a  new,  related 
problem  occurred  during  testing  and  therefore  PTR  OTE-052 
was  generated. 
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OTE-033 

Error  Setting  LAD  Availability  Bit 

Z 

Z 

10/1/97 
Software 
Major 
Groot 
ADAS  PSF 
4.18 

OTE-034 

ADAS/A WOS  ICD  par  30.3.2.2 

At  13:31  during  test  AL-08  the  cable  to  the  NLDN  controller 
was  disconnected.  It  wasn't  until  13:44  that  the  OTIS  OMO 
indicated  that  lightning  was  unavailable.  This  was  a  result  of 
ADAS  not  setting  the  LAD  availability  bit  (i.e..  NLDN  is  not 
available)  until  1 5  minutes  after  the  NLDN  was 
disconnected.  This  is  in  violation  of  the  ICD  par  30.3.2.2 
which  states  that  the  availability  bit  "shall  indicate  the  current 
availability  of  lightning  information  to  AWOS". 

2/10/98 -DGG 

See  OTIS  METAR  for  18:00  in  al-10-2.cap  for  OT&E  #2  for 
example  of  contradictory  TSBxx  and  TSNO/LTG  DATA 
MISG  remarks  in  same  message. 

Recommendation  DME  needs  to  fix  software  so  that  when  the  lightning  data  is 
no  longer  available  the  availability  bit  gets  set  immediately  to 
"indicate  the  current  availability  of  lightning  information". 

11/07/97  DGG 

Based  on  phone  conversations  on  10/16/97  with  DME  this 
PTR  was  going  to  be  closed  since  the  1 5  minute  persistence 
could  be  considered  "current  availability".  However,  when 
DME  submitted  there  summary  of  the  10/16/97  conference 
call  they  had  listed  this  PTR  as  DME  needing  to  provide  a 
fix.  Need  to  check  with  DME  as  to  the  status  of  this  PTR. 

1 1/26/97  -  DGG 

AUA  is  looking  into  the  correct  way  to  implement  this.  At 
PMR  AUA  indicated  that  the  TSNO  should  take  precedence 


PTR# 
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Notes 


whenever  the  ADAS  stops  receiving  lightning  data  from  the 
NLDN.  Therefore,  if  a  lightning  remark  or  TSB  is  still 
within  a  15  minute  persistence  window  and  the  ADAS  stops 
receiving  lightning  for  2  consecutive  minutes,  then  TSNO 
should  be  issued  and  all  lightning  remarks  and  TSB  should 
be  removed.  Once  AUA  resolves,  they'll  give  DME  direction 
on  how  to  implement  fix  for  the  Y2K  build.  Even  though 
this  is  a  Major  PTR  it  will  not  be  resolved  till  the  Y2K  build. 

4/9/98  -  DGG 

The  spec  has  been  updated  to  correspond  to  the 
recommended  change.  Spec  par  changed  was  3.1 ,4.2.3.2.5.3 
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OTE-034 

Contradictory  TSBmm  and  TSNO  Remarks 

y 

y 

10/1/97 

Software 

Major 

Groot 

ADAS  PSF 

4.18 

OTE-033 

ADAS/A WOS  ICD 
Par  90.3.2.12.1.5.2.(a) 

Par  90.3.2.12.3.10.1 

The  METAR  at  14:00  in  test  AL-08  contained  a  TSB23  and  a 
TSNO  remark.  Since  the  source  data  for  these  two  remarks  is 
Octets  57/58,  it  is  incorrect  to  have  these  two  remarks  present 
in  the  same  message. 

2/10/98 -DGG 

See  OTIS  METAR  for  18:00  in  al-10-2.cap  for  OT&E  #2  for 
example  of  contradictory  TSBxx  and  TSNO/LTG  DATA 
MISG  remarks  in  same  message. 

DME  needs  to  fix  the  software  so  that  these  remarks  are 
properly  generated. 

2/10/98  -  DGG 

As  with  PTR  OTE-033,  AUA  needs  to  give  DME  direction 
on  how  to  best  handle  this  PTR  for  the  Y2K  build. 

11/05/97  DGG 

This  PTR  was  closed  since  these  messages  are  consistent  with 
what  the  user's  want  and  with  the  requirements. 

2/10/98 -DGG 

While  reviewing  PTR  OTE-033,  realized  this  PTR  should 
never  have  been  closed  since  it  relates  directly  to  the  same 
problem  of  contradictory  remarks. 

4/9/98  -  DGG 
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The  ICD  has  been  changed  in  par  90.3.2.12.1.5.3  and  also  in 
90.3.2.12.1.4.3.  These  changes  will  be  consistent  with 
recommendation  in  OTE-033. 

Notes 
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OTE-035 

"THROUGH"  Instead  of"-"  in  ASOS  Lightning  Remarks 


is/ 

10/6/97 

Software 

Minor 

Groot 

ADAS  PSF 

ASOS 


ADAS/AWOS  ICD 
Par  10.3.20.1 
Par  30.3.3 
Table  30-3 

Analysis  of  data  for  AL-02B-2  revealed  that  the  ASOS  OMO 
used  "THROUGH"  in  the  lightning  remarks  instead  of  the 
ICD  directed  For  example,  the  OMO  at  18:07:00  had  the 
following  remark  "LTG  DSNT  S  THROUGH  W".  The 
remark  should  have  read  "LTG  DSNT  S  -  W". 

ASOS  software  needs  to  be  corrected  to  use  the  instead  of 
"THROUGH"  in  lightning  remarks.] 

1 1/26/97  -  DGG 

This  PTR  will  be  verified  as  corrected  during  ASOS  SAT 
ADAS/ASOS  testing  the  week  of  Dec  1 . 

12/05/97 -DGG 

Reviewing  the  data  for  al-02b-3-spl.doc  revealed  that  the 
"THROUGH"  has  been  removed  and  has  been  replaced  with 
a Therefore,  this  PTR  is  closed. 


Notes 
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OTE-036 

No  Tstorm  Beg  or  Tstorm  End  in 


V 

10/7/97 

Software 

Minor 

Groot 

ADAS  PSF 

AWOS 


ADAS/AWOS  ICD 
Par  10.3.4 

Analysis  of  live  AWOS  (OTIS)  OMO  data  for  test  AL-02B 
revealed  that  the  Alert  Data  bits  corresponding  to  Tstorm  Beg 
and  Tstorm  End  were  never  set. 

Can  also  find  examples  of  problem  in  AL-09  data. 

The  AWOS  software  needs  to  be  modified  to  correctly  report 
this  information. 

1 1/26/97  -  DGG 

Since  AWOS  is  not  required  to  set  these  bits  and  since  this 
information  is  never  used  as  source  data  for  any  Metar  fields 
this  PTR  should  be  closed.  The  only  remaining  issue  is 
whether  or  not  the  ICD  needs  to  be  updated  so  that  the  ITWS 
and/or  WARP  projects  don't  attempt  to  use  this  information. 

2/24/98  DGG 

Since  there  is  no  requirement  that  this  information  be  set  by 
the  AWOS,  the  PTR  is  being  closed.  Although  it  was  noted 
at  the  PMR  that  the  ICD  should  indicate  this  so  that  the 
ITWS  and  WARP  programs  are  aware  of  this,  AUA  decided 
not  to  change  the  ICD. 

4/9/98  -  DGG 

AUA  did  change  the  ICD  in  par  10.3.4 
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OTE-037 

ASOS  Erroneous  "LTG  DATA  MISG"  Remarks 

V 

10/21/97 

Software 

Major 

Groot 

ADAS  PSF 

ASOS 


ADAS/A WOS  ICD 
par  par  30.4.1.0 

Analysis  of  data  for  test  AL-02C-4  revealed  numerous  "LTG 
DATA  MISG"  remarks  in  the  live  ASOS  OMOs.  These 
remarks  were  not  consistent  with  the  LAD  messages  sent  out 
by  ADAS  and  the  live  AWOS  OMOs  did  not  contain  these 
remarks. 

10/22/97  DGG 

The  basic  purpose  of  the  test  was  to  check  all  the 
zones/sectors  15  minute  persistence.  One  lightning  strike,  for 
a  particular  zone  or  sector,  was  generated  at  time,  t  and 
ADAS  continued  to  send  LADs  with  the  particular  zone  or 
sector  in  alarm  status  through  time  t  +  15  minutes.  There 
were  numerous  occasions,  during  various  sector's  15  minutes 
of  persistence,  when  ASOS  generated  a  LTG  DATA  MISG 
remark  (instead  of  the  correct  sector  remark).  This  occurred 
for  any  minute  when  ASOS  did  not  receive  the  ADAS  LAD 
message  "on  time".  Since  the  ADAS  and  ASOS  one  minute 
processing  cycles  are  asynchronous  this  happens  when 
ADAS  sends  the  LAD  a  second  or  two  later  than  normal. 

NOTE:  This  problem  does  not  appear  occur  with  the  AWOS. 

1 1/07/97  DGG 

In  discussion  with  ADAS  program  office  it  was  pointed  out 
that  the  ADAS/AWOS  ICD  does  have  a  requirement  to  wait 
before  placing  the  LTG  DATA  MISG  remark  in  the  OMOs. 
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Notes 
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The  requirement  can  be  found  in  par  30.4.1  .(c).  Based  on 
this  paragraph  ASOS  should  wait  2  consecutive  minutes 
before  the  LTG  DATA  M1SG  remark  is  sent. 

The  ASOS  software  needs  to  be  corrected  to  eliminate  these 
erroneous  remarks. 

10/22/97  DGG 

No  solution  as  yet  has  been  given  by  SMI  to  this  problem. 
10/26/97  DGG 

One  solution  would  be  for  the  ASOS  to  put  in  some 
persistence  timer  that  would  require  them  to  wait  2  or  3  polls 
before  they  issue  a  "LTG  DATA  M1SG"  remark  (since 
AWOS  doesn't  have  this  problem,  we're  guessing  this  is  what 
they  do).  I  believe  this  would  require  a  change  in  the  1CD. 

11/07/97  DGG 

Since  there  is  a  requirement  to  handle  this  situation  ASOS 
should  implement  a  fix  to  wait  the  required  2  minutes. 

11/26/97 -DGG 

AUA  will  change  the  1CD  to  indicate  that  when  ADAS  stops 
receiving  lightning  data  from  NLDN  that  ASOS  waits  2 
minutes  and  then  issues  a  LTG  DATA  MISG  remark 
(actually  AUA  is  looking  to  change  all  LTG  DATA  MISG  to 
TSNO).  This  will  require  an  ASOS  software  change.  If  it  is 
implemented  in  the  ASOS  software  build  ver  2.5x  then  it  will 
be  tested  during  ASOS  SAT  ADAS/ASOS  testing  the  week 
of  Dec  1. 

3/16/98  -  DGG 

Sent  Wendell  Cook  e:mail  to  ask  him  the  status  of  this  PTR. 
4/9/98  -  DGG 

AUA  informed  ACT  that  it  was  agreed  that  the  AWOS  ICD 
would  be  changed  to  identify  that  AWOS/ASOS  should  wait 
2  minutes  before  setting  lightning  availability  to  unavailable. 
ICD  par  30.4.1(a)  would  be  changed  as  a  result  of  this 
problem. 

5/8/98  -  DGG 

Analysis  of  OT&E  #2  data  file  ai-02c-asos-sat.cap  revealed 
that  there  were  no  LTG  DATA  MISG  remarks  in  the  KSP1 
OMOs  while  there  were  LAD  messages  indicating  lightning 
remarks  for  zone  3.  It  was  during  this  scenario  that  the 
problem  was  first  discovered.  It  appears  that  it  has  been 
corrected  in  the  ASOS  software  (ver  2.52  or  2.53)  and 
therefore  this  PTR  has  been  closed. 

6/23/98  -  DGG 
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This  PTR  was  still  OPEN  at  the  time  the  OT&E  Final  Report 
was  written.  Therefore  it  is  listed  in  the  final  report  as  an 
OPEN  PTR.  Since  the  Final  Report's  completion,  further 
testing  has  occurred  and  as  a  result  the  PTR  is  now  CLOSED. 
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OTE-038 

AWOS  outside  ARTCC  boundaries 

V 

v 

10/21/97 

Software 

Major 

Groot 

ADAS  PSF 

4.18 


NAS-SS-1000 
Par  3.2. 1.5.8. 1.2.1 

Test  AL-05  was  designed  such  that  a  configuration  file  would 
have  an  AWOS  with  the  west  half  of  its  30  nm  area  inside  the 
ARTCC  boundaries  and  the  east  half  of  its  30nm  area  outside 
the  ARTCC  boundaries.  For  the  first  five  minutes  of  the  test, 
lightning  strikes  were  placed  within  30  nm  of  the  AWOS  and 
within  the  ARTCC  boundary.  For  the  second  five  minutes 
of  the  test,  lightning  strikes  were  placed  within  30  nm  of  the 
AWOS  and  outside  the  ARTCC  boundary.  Based  on  NAS 
level  requirements  all  of  these  strikes  should  have  resulted  in 
the  corresponding  zones  and  sectors  indicating  lightning  in 
the  LAD  messages  for  the  AWOS.  However,  the  second  five 
minutes  of  lightning  strikes  were  not  used  for  LAD  message 
generation. 

The  problem  here  is  that  the  ADAS  does  not  perform  a  check 
of  the  configuration  to  verify  that  no  part  of  an  AWOS's 
30nm  area  is  outside  the  ARTCC  boundaries. 

The  recommendation  is  that  the  ADAS  software  be  modified 
so  that  a  check  is  made  of  the  configuration  file  to  verify  that 
no  part  of  the  AWOS's  30nm  area  is  outside  the  ARTCC 
boundaries.  If  this  is  not  verified  errors  might  occur  (like 
those  simulated  in  test  AL-05)  and  result  in  lightning  strikes 
not  being  reported  to  an  AWOS. 

1 1/07/97  DGG 

AUA  needs  to  resolve  the  documentation  description  and 
then  direct  DME  to  incorporate  software  checks  into  the 
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ADAS  to  ensure  that  ASOS/AWOS  lat/longs  are  not  placed 
outside  the  ARTCC  boundaries. 

1 1/26/97  -  DGG 

At  PMR  it  was  decided  that  DME  would  propose  a  solution 
to  this  problem  to  be  implemented  for  the  Y2K  build. 

Action  Taken 
Notes 
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OTE-039 

TSNO  remark  missing 

V 

10/24/97 

Software 

Major 

Groot 

ADAS  PSF 

4.18 


ADAS/A WOS  ICD 
Par.  90.3.2.12.3.10.2 

Analysis  of  test  AL-10  revealed  that  when  OCT  57  and  58 
had  all  bits  set,  the  TSNO  remark  was  not  generated. 

Simulator  #4  for  this  test  was  setup  such  that  the  last  four 
minutes  of  the  test  OCT  57  &  58  were  each  set  to  255  (xff). 
According  to  the  ICD  Par  90,3.2.12.3.10.2  this  is  the  source 
data  for  generating  the  TSNO  remark. 

DME  needs  to  investigate  why  this  remark  is  missing. 

1 1/25/97  -  DGG 

At  PMR  it  was  confirmed  that  this  PTR  would  be  addressed 
by  DME  in  build  4.19. 

2/24/98  -  DGG 

This  was  verified  as  corrected  by  OT&E  #2  data  for  al-10, 
therefore  PTR  is  closed. 
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OTE-040 
Missing  SPECIs 


V 

10/24/97 

Software 

Major 

Groot 

ADAS  PSF 

4.18 


Analysis  of  test  AL-10  revealed  that  for  simulator  #4  there 
were  some  missing  SPECI  reports.  The  simulator  was  setup 
with  the  SPECI  bit  set  for  all  minutes.  Each  of  the  minutes 
with  the  aw_msg/ltg_end_o  1 4  failed  to  generate  the 
appropriate  SPECI  message. 

Although  it  appears  that  the  minutes  for  which  the  SPECIs 
were  not  generated  were  setup  properly,  further  investigation 
will  be  performed. 

1 1/07/97  DGG 

ACT-320  and  DME  need  to  investigate  why  this  problem 
occurred. 

1 1/26/97  -  DGG 

DME  pointed  out  that  the  length  of  ltg_end_ol4  is  69 
character  and  for  ltg_beg_ol4  it  is  68.  It  was  concluded  that 
probably  and  extra  space  is  resulting  in  no  SPECI 
generation.  DME  tested  this  out  and  verified.  This  PTR  will 
be  closed  once  test  is  rerun  during  OT&E  #2. 

2/24/98  -  DGG 

This  PTR  was  closed  once  the  aw_msg/ltg_end_ol4  was 
fixed.  OT&E  #2  data  for  al-10  verified  that  this  was  fixed. 
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OTE-041 

Lightning  Network  Status  Error 

V 

10/27/97 

Software 

Critical 

Groot 

ADAS  PSF 

4.18/3.12 


Analysis  of  test  AL-06x.itd  file  revealed  the  following 
problem.  ( Note:  although  75  simulators  were  used  the 
problem  will  be  illustrated  only  with  simulators  K001  and 
K075). 

At  10:59  the  NLDN  was  taken  "out  of  service".  Both  K001 
and  K.075  continued  to  correctly  indicate  all  zone/sectors 
with  lightning  until  11:15  and  11:14,  respectively.  After 
these  times  both  simulators  correctly  indicated  all 
zone/sectors  without  lightning.  Then  at  1 1 : 1 8  the  NLDN 
cable  to  ADAS  was  disconnected.  At  1 1 : 1 9  the  Lightning 
Network  Status  for  K001  correctly  went  to  "N'\  however,  the 
Lightning  Network  Status  remained  "Y"  for  K075  (and  most 
other  simulators)  until  1 1 :33.  After  the  NLDN  to  ADAS 
cable  was  reconnected  at  1 1:35,  K001  and  K075  had 
Lightning  Network  Status  as  "Y"  at  1 1 :36. 

DME  needs  to  investigate  if  this  was  an  ADAS  softw  are 
problem  or  if  this  was  an  IPS  problem. 

Never  sent  to  DME.  This  PTR  is  being  closed.  The 
statement  in  the  Discrepancy  Description  that  "After  these 
times  both  simulators  correctly  indicated  all  zone/sectors 
without  lightning"  is  incorrect.  In  the  transition  from  NLDN 
out  of  service  to  pulling  the  NLDN  to  ADAS  cable,  K075 
received  its  lightning  strikes  while  K001  did  not.  As  a  result. 
K075  began  a  new'  15  minutes  of  persistence  (at  11:18)  but 
K001  did  not.  Therefore,  K075  did  not  go  to  Lightning 
Network  Status:  "N"  until  1 1:33. 
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OTE-042 

Incorrect  NLDN  "Config  Active"  DP  Indication 

y 

y 

10/27/97 

Software 

Moderate 

Groot 

ADAS  PSF 

4.18 

OTE-043 

Probably  OTE  TVRTM  req 
LSS2-012 

Analysis  of  test  data  for  AL-06  revealed  that  the  NLDN 
Communications  DP  printout  indicated  the  NLDN 
Availability  Status  as  "online-normal"  and  the  Value  as 
"config-active"  for  the  conditions  when  the  NLDN  was  set  to 
"out  of  service"  and  when  the  NLDN  to  ADAS  was 
disconnected.  When  NLDN  was  set  to  "out  of  service"  the 
DP  printout  occurred  5  minutes  later.  When  the  NLDN  to 
ADAS  cable  was  pulled  the  DP  printout  occurred  12  minutes 
later. 

2/23/98  -  DGG 

During  DT&E  and  OT&E  tests  revealed  that  although  the 
original  software  problem  (of  the  NLDN  being  reported  as 
CFG  NOT  after  it  had  been  reconnected)  has  been  resolved, 
another  problem  still  exists  with  the  DP  printouts.  It  appears 
that  the  NLDN  Communications  and  ITWS  communications 
DP  printouts  were  not  coded  correctly.  Therefore  this  PTR 
remains  open,  but  it  has  been  downgraded  to  moderate. 

DME  needs  to  investigate  why  the  NLDN  Communications 
DP  printout  did  not  reflect  the  status  of  the  NLDN. 

1 1/26/97  -  DGG 

More  testing  indicates  that  ADAS  fails  to  set  the  DP  correctly 
when  ADAS  is  under  the  maximum  load  conditions.  Since 
ADAS  is  using  up  the  whole  mission  cycle  to  process 
lightning  strikes,  it  doesn't  always  properly  set  the  DP 
indicating  NLDN  "out  of  service".  DME  is  going  to 
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implement  the  fix  for  this  in  build  4. 1 9. 

2/23/98  -  DGG 

DME  needs  to  fix  the  DP  printout  to  correctly  indicate  the 
status  of  the  NLDN  and  1TWS  communications. 

Action  Taken 
Notes 
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OTE-043 

MPS  NLDN  Interface  Connection  Status  Error 


V 

10/28/97 

Software 

Major 

Groot 

ADAS  PSF 

4.18 

OTE-042 

ADAS/MPS  ICD 
Table  20-16 
OT&E  TVRTM  req. 

LSS2-012 

Analysis  of  the  IPS  MPS  file  for  test  AL-06  revealed  that  the 
NLDN  Interface  Connection  Status  DP  did  not  reflect  the 
current  condition  of  the  NLDN  Interface.  At  10:59  of  this 
test  the  NLDN  was  placed  in  an  "out  of  service"  condition. 

At  1 1 :01  the  NLDN  Interface  Connection  Status  DP 
indicated  a  Condition  Status  of  "configured  active".  Then  at 
11:18  the  cable  from  the  NLDN  to  ADAS  was  disconnected. 
It  wasn't  until  1 1:31  that  the  NLDN  Interface  Connection 
Status  DP  indicated  a  Condition  Status  of  "configured 
failed".  At  1 1:35  the  NLDN  cable  was  reconnected  to  ADAS 
however,  it  wasn't  until  12:16  that  the  NLDN  Interface 
Connection  Status  DP  indicated  a  Condition  Status  of 
"configured  active".  (See  the  notes  section  below  for 
excerpts  from  the  IPS  MPS  file.) 

DME  needs  to  investigate  why  the  NLDN  Interface 
Connection  Status  DP  does  not  indicate  the  proper  Condition 
Status. 

1 1/26/97  -  DGG 

More  testing  indicates  that  ADAS  fails  to  set  the  DP  correctly 
when  ADAS  is  under  the  maximum  load  conditions.  Since 
ADAS  is  using  up  the  whole  mission  cycle  to  process 
lightning  strikes,  it  doesn't  always  properly  set  the  DP 
indicating  NLDN  is  down,  DME  is  going  to  implement  the 
fix  for  this  in  build  4. 19. 
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Action  Taken  2/23/98  -  DGG 

Since  the  problem  of  stated  in  this  PTR  has  been  resolved  it 
will  be  closed.  The  related  PTR  OTE-042  will  remain  open 
to  track  the  problem  of  incorrect  DP  printouts  for  NLDN  and 
ITWS  communications. 

Notes  RMS  ID:  0x01  LOGICAL  UNIT  ID:  0x2d 

DELIMITER:  0x00  MESSAGE 

FUNCTION:  0x47 

DATE:  09/10/97  TIME:  11:01:18 

AVAILABILITY  STATUS:  (0x20)  Online  Normal 
DATAPOINTID:  0x01  CONDITION 

STATUS:  0x40 

DATA  TYPE:  0x01  RESOLUTION: 

0x00 

PARAMETER  VALUE:  (002)  Decimal 
(02)  Hex  " 

()  ASCII 


RMS  ID:  0x01  LOGICAL  UNIT  ID:  0x2d 

DELIMITER:  0x00  MESSAGE 

FUNCTION:  0x47 

DATE:  09/10/97  TIME:  11:31:14 

AVAILABILITY  STATUS:  (0x20)  Online  Norma! 
DATAPOINT  ID:  0x01  CONDITION 

STATUS:  0x42 

DATATYPE:  0x01  RESOLUTION: 

0x00 

PARAMETER  VALUE:  (001 )  Decimal 
(01)  Hex 
()  ASCII 


RMS  ID:  0x01  LOGICAL  UNIT  ID:  0x2d 

DELIMITER:  0x00  MESSAGE 

FUNCTION:  0x47 

DATE:  09/10/97  TIME:  12:16:27 

AVAILABILITY  STATUS:  (0x20)  Online  Normal 
DATAPOINTID:  0x01  CONDITION 

STATUS:  0x40 

DATATYPE:  0x01  RESOLUTION: 

0x00 

PARAMETER  VALUE:  (002)  Decimal 
(02)  Hex 
()  ASCII 
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OTE-044 

Erroneous  Event  2 1 

V 

V 

10/29/97 

Software 

Moderate 

Groot 

ADAS  PSF 

4.18 


Analysis  of  test  AL-08  event  log  revealed  that  during  times 
when  no  comm  problems  existed  for  the  ADAS/NLDN 
interface  an  EVENT  21  was  generated.  These  EVENT  21 
messages  were  always  generated  around  :45  seconds  past  the 
minute.  The  following  is  an  example  of  this. 

EVENT  PRIORITY:  non-critical  DATE/TIME  STAMP: 
09-12-97  13:26:45 

EVENT  SEQ.  NUMBER:  289  EVENT  TYPE:  21  CSC 
ID:  11.02 

An  erroneous  message  has  been  triggered  by  System  Logging. 

message  type:  ADAS  received  error  message 
error  type:  NLDN  error  message  error  code:  Invalid 
message  type 

original  esc  id:  22.01  error  number:  12 
error  offset:  353 

DME  needs  to  investigation  why  these  EVENT  2 1  s  are 
generated. 

1 1/26/97 -DGG 

At  the  PMR  DME  explained  that  EVENT  21  messages  are 
generated  every  minute  because  every  minute  the  NLDN 
system  sends  a  messages  that  is  erroneous  (based  on  the 
ADAS  Spec  requirements).  As  a  result.  ADAS  generates  this 
message.  It  was  determined  at  the  PMR  that  instead  of 
making  a  change  to  the  Spec.  DME  would  generate  a  PCR 
about  this  problem  and  AUA  would  direct  them  to  fix  it  by 
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removing  EVENT  21  messages  corresponding  to  these 
NLDN  messages  that  are  sent  every  minute.  DME  will 
generate  this  PCR  and  incorporate  changes  for  the  Y2K  build. 

Action  Taken 
Notes 
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PTR  DETAILED  REPORT  -  ALL 


OTE-045 

Corrupted  Context  Sensitive  Help  Index 

✓ 

7 

10/01/97 

Software 

Moderate 

Stratton 

ADAS  PSF 

4.18 


The  Specialist  Interface  always  displays  a  Help  Screen  when 
the  HELP  Key  is  pressed.  But  in  many  cases  not  the  correct 
help  screen.  Two  examples  are  any  of  the  Display  Datapoint 
screens  (e.g.  Login  SI,  F10,  F7,  {any  selection},  RETURN, 
HELP)  and  any  Display  Datapoint  Thresholds  screen  (e.g. 
Login  SI,  F8,  F7,  {select  Datapoint  Thresholds},  RETURN, 
{any  selection},  RETURN,  HELP}. 

DME  needs  to  be  verify  that  the  help  screens  are  using  the 
most  current  ADAS  System  Manual  for  the  Help  screens 
content,  and  that  pointers  in  the  help  index  are  correct  for  all 
SI  screens. 

1 1/26/97  -  DGG 

DME  indicated  at  PMR  that  they  plan  on  implementing 
changes  in  the  Y2K  build. 


DEFERRED  to  ADAS  Y2K  build. 
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PTR  Open 
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Criticality 
Originator 
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Software  Version 
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Affected  Reqs 
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Action  Taken 
Notes 


OTE-046 

Spacebar  does  not  clear  field 

V 

S 

10/30/97 

Software 

Moderate 

Stratton 

ADAS  PSF 

4.18 


During  the  OT&E  Formal  Test  Run  of  DT&E  Test  120 
(Adaptation  Data  Test),  in  step  4.1.1.6.168,  the  operator  is 
instructed  to  press  the  spacebar  to  clear  the  erroneous  data 
from  the  RISE/FALL  Threshold  Field  the  enter  valid  data. 
When  the  spacebar  was  pressed,  the  field  was  not  cleared. 
(NOTE:  In  all  other  fields  tested  by  this  procedure,  the 
spacebar  did  clear  the  field.) 

DME  needs  to  Evaluate. 

1 1/26/97 -DGG 

At  the  PMR  DME  indicated  that  they  are  still  investigating, 
but,  they  believe  there  is  a  problem  and  will  implement 
changes  in  the  Y2K  build. 


DEFERRED  to  ADAS  Y2K  build. 
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OTE-047 

NLDN  Flash  Buffer  Box 

V 

V 

01/06/98 

Documentation 

Moderate 

Vuong 

ADAS  PSF 

4.19 


In  order  to  establish  a  communication  between  NLDN  and 
ADAS,  ADAS  specialist  need(s)  to  set  a  dip  switches  in  the 
Flash  buffer  box.  Following  are  four  dip  switches  that  need 
to  set  in  the  buffer  box  : 

1 .  The  dip  switch  ( 1 )  for  data  output  (O/P)  will  be  set  at 
19.2K  baud  rate,  8  bit  and  none  parity. 

2.  The  dip  switch  (2)  for  data  input  (I/P)  will  be  set  at  1 ,2K 
baud  rate,  8  bit  and  none  parity. 

3.  The  dip  switch  (3)  which  is  inside  the  buffer  box  will  be 
set  at  DTE. 

4.  The  dip  Switch  (4)  which  is  inside  the  buffer  box  will  be 
set  at  DCE. 

DME  or  AOS  need  to  incorporate  a  schematic  figure(s)  and 
procedures  in  the  Technical  Instruction  Manual  (TI)  or 
Installation  Checkout  and  Acceptance  (IC&A). 

4/9/98  -  DGG 

AOS  has  reported  that  this  documentation  has  been 
implemented.  ACT  has  not  inspected  these  changes  yet. 
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PTR  DETAILED  REPORT  -  ALL 


OTE-048 

Overrun  of  Mission  Cycle 

Z 

z  ■ 

01/14/98 

Software 

Major 

Schlain 

ADAS  Test  Lab 
4.19 


When  an  AWOS-Format  Message  received  by  ADAS  is 
determined  to  be  in  error,  ADAS  will  log  this  error  and 
generate  an  error  message  to  the  station  originating  the 
message  in  error.  In  the  present  software  implementation, 
ADAS  will  remain  in  the  polling  phase  of  the  Mission  cycle 
until  a  correct  message  is  received  from  the  station  in 
question.  Since  in  most  cases  this  won’t  occur  for  at  least  a 
minute,  ADAS  will  overrun  the  Mission  Cycle,  and  skip  the 
Archive,  Maintenance,  LAD  generation,  and  Clock  Update 
Phases. 

ADAS  should  not  overrun  a  Mission  Cycle  due  to  a  message 
received  in  error  from  an  AWOS  Station  or  all  stations  on  a 
given  channel  or  even  all  stations  on  a  given  Controller. 
ADAS  should  log  the  error(s)  and  generate/transmit  the  error 
message(s).  ADAS  should  not  skip  any  phases  of  the  Mission 
Cycle.  The  software  should  be  modified  accordingly. 
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OTE-049 

Failure  to  Validate  Message  Length  for  AWOS  Stations 

V 

V 

01/14/98 

Software 

Major 

Schlain 

ADAS  Test  Lab 
4.19 


ADAS  System  Spec,  FAA-E-2804,  Section  3. 1 .4. 1 .2. 1 

The  above  referenced  requirement  states  that  ADAS  shall 
validate  the  message  Format  ID/Type  and  Message 
Type/Length.  The  present  software  only  validates  the 
Message  Type/Length  for  AWOS  type  stations  -  not  ASOS 
type  stations. 

The  software  be  modified  to  validate  the  Message 
Type/Length  for  ASOS  stations  also. 

4/13/98 -DGG 

It  was  determined  during  4/7  and  4/8/98  telcons  with  ACT, 
AOS  and  AUA  that  since  the  code  is  already  in  place  to  do 
this  for  AWOS  and  that  these  validations  should  be  done  for 
ASOS  and  since  the  SPEC,  although  contradictor)',  states  it 
should  be  done,  this  software  change  should  be  implemented. 

4/13/98 -DGG 

It  was  agreed  that  AOS  would  make  the  necessary  software 
changes  to  implement  this  software  mod.  AUA  would 
correct  the  SPEC  so  that  there  would  be  no  contradictions 
concerning  the  validation  of  ASOS  type  messages. 
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OTE-050 

Failure  to  check  site  ID 

7 

01/05/98 

Software 

Moderate 

Schlain 

ADAS  Test  Bed 
4.19 


The  ADAS  does  not  check  the  site  ID  of  incoming  AWOS- 
Format  messages.  This  means  that  One  Minute  Observation 
(OMO)  AWOS-Format  messages,  which  satisfy  the  other 
ADAS  checks,  could  be  sent  to  the  WARP,  ITWS,  and  DLP 
subsystems  with  site  IDs  which  do  not  match  those  in  the 
databases  of  these  subsystems.  Also,  ADAS-generated 
METAR  messages  could  be  sent  to  the  WMSCR  with  a  site 
ID  that  WMSCR  does  not  recognize.  (The  permissible  site 
IDs  are  contained  in  FAA  document  7350. 6W  "Site 
Identifiers"). 

In  order  to  avoid  the  confusion  which  would  arise  if  a 
NADIN  II  user  of  ADAS  receives  an  OMO(s)  or  a  METAR 
message  from  a  site  it  doesn't  recognize,  it  is  recommended 
that  the  ADAS  software  check  the  site  ID  of  every  message 
before  transmission  to  a  NADIN  II  user. 

4/9/98  -  DGG 

During  the  telecons  between  AUA,  AOS  and  ACT  on  4/7  and 
4/8,  it  was  agreed  that  the  Spec  needed  to  be  clarified  and  that 
the  software  should  be  changed  to  have  the  ASOS  message 
length  checked.  The  code  to  perform  this  is  already  in  place 
since  this  check  is  performed  for  AWOS  sites.  This  software 
will  be  implemented  by  DME  and  AUA  will  clarify  the  Spec. 

4/9/98  -  DGG 

During  telecon  on  4/7  and  4/8,  AUA,  AOS,  and  ACT  agreed 
that  this  PTR  would  be  closed  since  it  was  not  an  ADAS 
responsibility  or  requirement  to  check  this. 
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OTE-051 
ASC  SI  Lockup 


15/ 

1/13/98 

System 

Moderate 

Schlain 

ADAS  PSF 

4.19/3.12 


During  routine  use  of  the  ADAS  SI,  the  ASC  stopped 
responding  to  keyboard  input. 

[  The  ASC  terminal  was  powered  down,  triggering  UNIX  to 
terminate  process  associated  with  the  terminal  and  spawn  a 
'getty'  (login  prompt)  process.  The  ASC,  and  the  SI,  resumed 
normal  operations.  ] 

JKS:  Not  repeatable;  may  be  random,  or  testbed  setup 
induced,  error;  therefore  advise  PTR  be  closed  with 
notification  of  ACT/AOS/AUA  et  al  to  key  an  eye  open  for 
possible  future  occurrences. 

2/25/98  -  DGG 

Since  this  was  not  repeatable  this  PTR  is  closed. 
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OTE-052 

Missing  TSExx  for  AWOS  SPECI 

✓ 

V 

02/05/98 

Software 

Moderate 

Groot 

ADAS  PSF 

4.19 


During  analysis  of  OT&E  #2  al-02c-!  data  every  OTIS 
SPECI  within  a  given  hour  that  contained  more  than  one 
TSBxx  and  that  ended  the  Thunderstorm  portion  of  the 
present  weather  begin/end  remark  field  with  a  Bxx,  did  not 
contain  the  first  TSExx  that  occurred  during  that  hour. 

DME  needs  to  investigate  why  this  occurred.  It  does  not 
appear  to  be  a  requirement  in  the  ICD. 
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OTE-053 

WMSCR  does  not  recognize  SPECIs  w/  in  ADUs  w/  "SA"  W 

itZ 

2/6/98 

Other 

Moderate 

Stratton 

ADAS  PSF 

4.18/4.19 


WMSCR  looks  at  WMO  Header  Type.,  not  at  the  ADU 
contents,  to  identify  a  SPECI. 

AOS-530  has  begun  development  of  a  patch  to  correct  the 
Header  Type. 

AOS-530  has  developed  a  fix.  ACT-320  will  verify  the 
functionality  of  the  fixed  software  and  monitor  AOS 
inclusion  of  the  fix  into  the  delivered  software  prior  to 
delivery  to  field  sites. 

AOS-530  delivered  new  'cwm_ouf  binary  for  testing.  ACT- 
320  testing  confirms  the  WMO  Type  is  SP  for  Speci  Message 
ADU's. 

Reverify  in  Deployment  build. 
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OTE-054 

ASOS  Multiple  TSBxx  remarks 

V 

V 

2/24/98 
Software 
Major 
Groot 
ADAS  PSF 
4.19  /ASOS 


Analysis  of  al-02b-2.cap  data  revealed  that  the  ASOS,  KSP1, 
indicated: 

1 .  multiple  TSBxx  remarks  without  any  Exx  imbedded  in  the 
message. 

2.  cases  where  there  was  a  SPECI/METAR  reported  in  hour. 
HI,  and  then  another  SPECI/METAR  in  the  next  hour,  H2. 
The  problem  was  that  in  the  H2  SPECI/METAR  the  TSB 
remark  that  was  carried  over  from  hour  HI,  did  not  contain 
the  hour  indicator  in  the  TSB  remark,  (i.e.  The  H2 
SPECI/METAR  contained  TSBxx  and  not  the  expected 
TSBhhxx). 

3.  some  of  the  TSBxx  minutes  changed  from  one  SPECI  to 
the  next  SPECI.  e.g..  in  one  SPECI  TSB12  would  be 
indicated  and  in  the  next  TSB  17  would  appear. 

The  ASOS  software  needs  to  be  examined  to  determine  the 
problem. 

On  2/19/98  Wendell  Cook  sent  an  email  message  indicating 
that  they  knew  about  the  problem  in  1.  Need  to  let  them 
know  about  2.  and  3. 

3/16/98 -DGG 

Sent  Wendell  Cook  e:mail  to  ask  him  the  status  of  this  PTR. 


B-83 


ALDARS  PTR  PET  ATT ,F,D  REPORT  -  AT.T, 


PTR# 

PTR  Title 

PTR  Open 
PTR  Accepted 
Discover  Date 

Failure  Category 

Criticality 

Originator 

Location 

Software  Version 

Related  PTRs 

Affected  Reqs 

Discrepancy 

Discription 


Recommendation 


OTE-055 

No  TSExx  after  15  Minute  LAD  Disable 

V 


2/18/98 

Documentation 

Moderate 

Groot 

ADAS  PSF 
4.19 


ADAS/A WOS  ICD 
90.3.2.12.1.5.3 

Analysis  of  results  for  OT&E  # 2  test  data  al-09-2.cap 
indicates  that  when  OTIS  station  was  LAD  disabled  at  14:34 
and  remained  disabled  until  14:56,  no  TSExx  was  generated. 
At  1433Z  an  OTIS  SPECI  was  generated  indicating  "LTG 
DSNT  NE  AND  SE  TSB13".  The  next  report  for  OTIS  was 
the  hourly  METAR  at  1500Z  which  contained  no  remarks 
about  lightning.  There  should  have  been  an  indication  in  the 
METAR  that  the  lightning  had  ended. 

4/13/98 -DGG 

Examination  of  test  data  for  AL-09  from  4/8/98  live  testing 
with  OTIS  reveals  that  from  13:34  to  13:43  OTIS  site  was 
LAD  Disabled.  The  ICD  states  that  if  there  was  lightning 
active  prior  to  setting  the  LAD  disabled,  the  disabling  lasted 
less  than  10  minutes,  and  the  lightning  was  still  active  after 
the  10  minutes,  then  there  should  be  a  continuation  of  the 
event.  However,  the  SPEC  states  that  all  lightning  history  is 
wiped  out  when  a  LAD  disable  occurs. 

Need  to  investigate  why  this  TSExx  was  never  included  in 
the  METAR  at  1500Z 

4/13/98 -DGG 

The  ICD  needs  to  be  clarified  and  updated  so  that  the  LAD 
disabled  LTG  DATA  MISG  that  is  less  than  15  minutes  is  to 
be  excluded  from  the  conditions  for  the  continuation  of  an 
event. 
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AT.DARS 

Action  Taken 


PTR  DF.T  A  IT  FT)  REPORT  -  ALL 


4/9/98  -  DGG 

Re-evaluation  of  this  PTR  indicated  that  for  the  case 
described  above,  ADAS  handled  this  scenario  correctly. 
However,  further  tests  were  to  be  performed  to  determine  if 
ADAS  would  handle  properly  if  the  LAD  disable  was 
implemented  for  less  than  1 5  minutes  while  a  TSBxx  remark 
was  generated. 

4/13/98 -DGG 

This  PTR  was  modified  from  the  original  and  now  is 
considered  to  be  a  Documentation  PTR  and  not  a  software 
PTR. 


Notes 
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OTE-056 

ASOS  Multiple  TSBxx,  no  TSExx 

aZ 

2/23/98 
Software 
Moderate 
Groot 
ADAS  PSF 
4. 19 /ASOS 

This  discrepancy  was  already  identified  in  PTR  OTE-054. 

ASOS  personnel  indicated  that  this  problem  was  being 
investigated  by  the  ASOS  software  developers. 

This  PTR  is  closed  since  it  was  all  ready  included  in  PTR 
OTE-054. 
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PTR  DETAILED  REPORT  -  ALL 


OTE-057 

Wrong  Quadrant  for  Lightning  Remark 


V 

2/23/98 
Software 
Major 
Groot 
ADAS  PSF 
4.19 /ASOS 


Analysis  of  the  data  for  test  AL-09  (file  al-09-4.*)  revealed 
that  at  19:03  the  LAD  (saved  by  the  ADAS  IPS)  indicated 
lightning  in  theN  and  SW  quadrants.  However,  the  1903Z 
SPECI  for  the  ASOS  (KSP1)  reported  in  the  lightning 
remarks,  LTG  DSNT  NE  AND  SW.  The  AWOS  format 
weather  message  at  19:03  for  KSP1  also  had  LTG  DSNT  NE 
AND  SW  and  22  hex  for  the  sector  information 
(corresponding  to  lightning  in  the  NE  and  SW  quadrants). 
Wendell  Cook,  from  ASOS  project,  investigated  and  found 
that  the  data  that  was  captured  by  NWS  indicated  a  LAD  with 
22  hex  (corresponding  to  the  NE  and  SW  sectors). 

It  is  unclear  why  this  anomaly  occurred.  Since  this  test  was 
using  live  lightning  data  the  only  way  to  attempt  to  repeat  it 
will  be  for  ACT-320  to  simulate  the  conditions  with  the  IPS. 

2/25/98  -  DGG 

When  running  this  test  the  way  that  LAD  messages  are  stored 
(on  the  ADAS  IPS)  for  the  live  ASOS/AWOS  is  to  have  a 
simulated  station,  K001,  set  up  on  the  IPS.  Because  this 
station  can  not  have  exactly  the  same  lat/long  as  the  live 
stations,  the  latitude  is  always  .05  minutes  different.  After 
analyzing  the  saved  lightning  data  on  the  NLDN  it  was 
determined  that  the  lightning  strike  that  precipitated  this  PTR 
being  written  happened  to  fall  right  on  the  22.5  degree  border 
between  the  N  and  NE  sector.  As  a  result,  ADAS  computed 
that  this  lightning  strike  was  associated  with  the  N  sector  for 
K001  but  in  the  NE  sector  for  KSP1.  Although  normally 
these  stations  report  exactly  the  same,  in  this  odd  case  they 
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report  something  different.  As  a  result  of  this  analysis,  this 
PTR  is  dosed. 

Notes 
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PTR# 

OTE-058 

PTR  Title 

Good/Bad  Quality  Factor  Bit  Flip  Flop 

PTR  Open 

£ 

PTR  Accepted 

£ 

Discover  Date 

2/23/98 

Failure  Category 

Software 

Criticality 

Major 

Originator 

Groot 

Location 

ADAS  PSF 

Software  Version 

4.19 /GAI 

Related  PTRs 

While  running  live  lightning  tests  on  2/19/98.  observed  very 
few  lightning  strikes  being  processed  by  ADAS  for  inclusion 
in  LAD  messages.  Further  analysis  of  al-09-4  data 
(specifically  the  ITWS  file)  revealed  that  of  97  lightning 
strikes  during  the  test  only  5  had  a  good  quality  factor  bit. 
Contacted  GAI  (William  Brooks)  to  ascertain  why  such  a 
small  percentage  had  a  good  quality  factor  bit.  He  was 
investigating  why  this  had  occurred.  As  of  2/23/98.  William 
Brooks  suspected  that  somehow  GAI  had  inadvertently 
swapped  good  quality  strikes  for  bad  quality  strikes  and  vice 
versa. 

Recommendation  GAI  needs  to  provide  a  final  assessment  of  the  problem. 

Based  on  the  findings  of  the  GAI  investigation  this  PTR 
could  be  upgraded  to  Critical. 

3/27/98  -  DGG 

After  GAI  reported  last  week  that  the  QFB  had  been  flip 
flopped,  ACT-32  requested  that  GAI  provide  details  as  to 
how  and  why  this  error  occurred  and  how  it  will  be  prevented 
in  the  future.  ACT-320  has  also  recommended  that  ADAS 
software  be  modified  to  have  a  DP  that  tracks  the  ratio  of 
good  to  bad  flashes,  and  when  this  ratio  falls  below  a 
predefined  value  (eg.  90%)  then  an  alarm  would  be  issued. 

Action  Taken  3/27/98  -  DGG 

Last  week  Bill  Brooks  from  GAI  called  to  inform  ACT-320 
that  their  software  engineers  had  found  the  QFB  flip  flopped. 
They  believe  they  have  corrected  the  problem.  ACT-320  has 
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requested  that  GAI  provide  details  as  to  how  and  why  this 
error  occurred  and  how  it  will  be  prevented  in  the  future. 

ACT-320  has  also  recommended  that  ADAS  software  be 
modified  to  have  a  DP  that  tracks  the  ratio  of  good  to  bad 
flashes,  and  when  this  ratio  falls  below  a  predefined  value 
(eg.  90%)  then  an  alarm  would  be  issued. 


Notes 
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APPENDIX  C 


TEST  PROCEDURES  STEPS  AND  ASSOCIATED  TEST  DATA 


C.  APPENDIX  C  -  Test  Procedure  Steps  &  Associated  Test  Data 

This  appendix  lists  OT&E  tests'  procedure  steps,  and  details  of  Associated 
Evaluation  Criteria  and  Data.  A  hard  copy  of  the  files  referenced  in  this 
appendix  would  be  thousands  of  pages  in  length.  For  this  reason,  the 
referenced  data  files  are  provided  as  an  attachment  to  this  report.  Any  files 
referenced  in  this  appendix  reside  in  storage  with  ACT-320  at  the  FAA 
Technical  Center  in  Atlantic  City,  NJ. 


C.l.  CATEGORY  AL  -  Automated  Lightning  Tests 


C.1.1.  TEST  AL-01A  -  ALDARS  Interface 

The  following  paragraphs  provide  information  about  data  associated  with  this 
test  but  not  included  within  the  main  body  of  this  report. 


C.l. 1.1.  Associated  Evaluation  Criteria  and  Data 

The  following  Evaluation  Criteria  were  used  to  determine  the  requirements 
passed/failed.  The  Cross  Reference  (CR)  numbers  can  be  used  to  trace  into  the 
data  found/referenced  below. 

Pass  Fail 


a.  [  X]  [ 


b.  t  x]  [  ] 

c.  [x]  [  ] 


Each  test  procedure  step's  "pass"  box,  in  the  'Observed 
Results'  column  is  marked,  indicating  the  'Expected 
Response'  was  observed  and/or  the  correct  action  was 
performed  successfully.  (See  Appendix  C  for  the  test 
procedures  performed  for  this  test) . 

NLDN  to  ADAS  (216  bits  and  667  times/minute) . 

CR01  NAS -  SS-TOOO,  Vol.  II  Table  3 . 2 . 1 . 5 . 8 . 3-Tlk  LSS2-024 

The  correct  receipt  of  these  messages  by  the  ITWS 

216  bits  and  667  times/minute) .  CR02  NAS-SS-1000, Vol .  II 

Table  3 . 2 . 1 . 5 . 8 . 3-Till  ISS2-005 


The  following  data,  marked  with  evaluation  criteria  cross-reference  numbers, 
is  a  subset  of  the  OT&E  formal  test  run  data.  Other  relavent  data  has  been 
included  into  test  AL-OlA's  Test  Conduct  Form  (TCF)  file,  "AL-OIA.TCF" . 


DATA  EXTRACTED  FROM  IPS  FILE: 


07-30-97  18:17:54  .  Events:  2 


Responses:  0  .  Message  Output  Cmds 
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DISPLAY  INPUT  MESSAGE  LOG 


INPUT  MESSAGE:  5 

RECEIVE  TIME  (IPS):  07/30/97  18:15:06 
RECEIVE  TIME  (ADAS) : 07/30/97  18:15:06 
SIMULATOR  ID:  6 

MESSAGE  TYPE:  ITWS1 . LDD.MSG 

MESSAGE  SIZE:  110 

GROUP  ID:  4 


HEX  DUMP  OF  TEST  FILE: 

01  Od  Od  0a  20  20  20  20  20  20  20  20  20  Od  Od  Oa  4c  44  55  53 

30  31  20  41  43  54  59  20  33  30  31  38  31  35  20  00  00  00  Od  Od 

Oa  00  03  34  cO  23  b3  31  a9  74  d2  58  22  48  77  75  d2  58  22  48 

ce  76  d2  58  22  48  92  74  d2  58  22  48  92  74  d2  58  22  48  92  74 

d2  58  22  48  92  74  d2  58  22  48  92  74  d2  58  22  48  04  cO  23  b3 

31  04  cO  23  b3  31  Od  Od  Oa  03 


ITWS1  LDP  INCOMMING  MESSAGE  CR01 

INPUT  MESSAGE  LOG  -  TEST  ID:  AL-01A  VERS:  1 


INPUT  MESSAGE  #: 


5 


RECEIVE  TIME  (IPS) : 
RECEIVE  TIME  (ADAS ) : 
SIMULATOR  ID: 

MESSAGE  TYPE: 
MESSAGE  SIZE: 

GROUP  ID: 

MESSAGE  TYPE:  ITWS1 
HEADER: 

TYPE: 

GEOGRAPHIC  DESIG: 
BULLETIN: 

SITE  ID: 

DAY/HOUR/MINUTE : 
Number  of  Messages 


07/30/97  18:15:06 
07/30/97  18:15:06 
6 

ITWS1_LDD_MSG 

110 

4 

LDD 

0x01 

LD 

US 

01 

ACTY 

30/18/15 

3 


LDD  FORMAT  IN  HEXDECIMAL 


LENGTH  INDICATOR  :34 


DATE/TIME  FIELD 

:  cO 

23 

b3 

31 

FLASH 

RECORD 

#01 

:a9 

74 

d2 

58 

22 

48 

FLASH 

RECORD 

#02 

:  77 

75 

d2 

58 

22 

48 

FLASH 

RECORD 

#03 

:  ce 

76 

d2 

58 

22 

48 

FLASH 

RECORD 

#04 

:  92 

74 

d2 

58 

22 

48 

FLASH 

RECORD 

#05  • 

:  92 

74 

d2 

58 

22 

48 

FLASH 

RECORD 

#06 

:  92 

74 

d2 

58 

22 

48 

FLASH 

RECORD 

#07 

:  92 

74 

d2 

58 

22 

48 

FLASH 

RECORD 

#08 

:  92 

74 

d2 

58 

22 

48 

C-2 


LENGTH  INDICATOR  : 04 
DATE/TIME  FIELD  : cO  23  b3  31 


LENGTH  INDICATOR  : 04 
DATE/TIME  FIELD  :  cO  23  b3  31 
No  more  messages  in  this  ADU 


INPUT  MESSAGE  #:  6 

RECEIVE  TIME  (IPS):  07/30/97  18:15:13 

RECEIVE  TIME  (ADAS) :  07/30/97  18:15:13 

SIMULATOR  ID:  6 

MESSAGE  TYPE:  ITWS1_LDD_MSG 

MESSAGE  SIZE:  52 

GROUP  ID:  5 

MESSAGE  TYPE:  ITWS1  LDD 

HEADER:  0x01 

TYPE:  LD 

GEOGRAPHIC  DESIG:  US 

BULLETIN:  01 

SITE  ID:  ACTY 

DAY/HOUR/MINUTE:  30/18/15 

Number  of  Messages  1 

LDD  FORMAT  IN  HEXDECIMAL 

LENGTH  INDICATOR  : 04 
DATE/TIME  FIELD  : cO  23  b3  31 
No  more  messages  in  this  ADU 


INPUT  MESSAGE  #:  7 

RECEIVE  TIME  (IPS) :  07/30/97  18:15:20 

RECEIVE  TIME  (ADAS) :  07/30/97  18:15:20 

SIMULATOR  ID:  6 

MESSAGE  TYPE:  ITWSl_LDD_MSG 

MESSAGE  SIZE:  57 

GROUP  ID:  7 

MESSAGE  TYPE:  ITWS1  LDD 

HEADER:  0x01 

TYPE:  LD 

GEOGRAPHIC  DESIG:  US 

BULLETIN:  01 

SITE  ID:  ACTY 

DAY/ HOUR/MINUTE:  30/18/15 

Number  of  Messages  2 

LDD  FORMAT  IN  HEXDECIMAL 

LENGTH  INDICATOR  :04 

DATE/TIME  FIELD  : cO  23  b3  31 


LENGTH  INDICATOR  :04 
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DATE/TIME  FIELD  :cO  23  b3  31 
No  more  messages  in  this  ADU 


INPUT  MESSAGE  #:  8 

RECEIVE  TIME  (IPS) :  07/30/97  18:15:30 

RECEIVE  TIME  (ADAS):  07/30/97  18:15:30 

SIMULATOR  ID:  6 

MESSAGE  TYPE:  ITWS1_LDD_MSG 

MESSAGE  SIZE:  110 

GROUP  ID:  8 

MESSAGE  TYPE:  ITWS1  LDD 

HEADER:  0x01 

TYPE:  LD 

GEOGRAPHIC  DESIG:  US 

BULLETIN:  01 

SITE  ID:  ACTY 

DAY/HOUR/MINUTE:  30/18/15 

Number  of  Messages  __3 

LDD  FORMAT  IN  HEXDECIMAL 

LENGTH  INDICATOR  :04 

DATE/TIME  FIELD  :c0  23  b3  31 


LENGTH  INDICATOR 
DATE/TIME  FIELD 
FLASH  RECORD  #01 
FLASH  RECORD  #02 
FLASH  RECORD  #03 
FLASH  RECORD  #04 
FLASH  RECORD  #05 
FLASH  RECORD  #06 
FLASH  RECORD  #07 
FLASH  RECORD  #08 


:  34 

:d9  23  b3  31 
: 92  74  c5  58  22  48 
: 92  74  50  58  22  48 
: 92  74  8d  57  22  48 
: 92  74  d2  58  22  48 
: 92  74  d2  58  22  48 
: 92  74  d2  58  22  48 
: 92  74  d2  58  22  48 
: 92  74  d2  58  22  48 


LENGTH  INDICATOR  : 04 
DATE/TIME  FIELD  :d9  23  b3  31 
No  more  messages  in  this  ADU 


NLDN  LDD  OUTGOING  MESSAGE  CR01 

OUTPUT  MESSAGE  LOG  -  TEST  ID:  AL-01A  VERS:  1 


07/30/97  18 : 15:00  FLASHMESSAGE 

7d96  c023  b331  a974  d258  2248  7775  d258  2248  ce76  d258  2248  9274  d258 
2248  9274  d258  2248  9274  d258  2248  9274  d258  2248  9274  d258  2248  767e 

07/30/97  18:15:00  FLASHMESSAGE 
7d96  c023  b331  f77e 

07/30/97  18:15: 05  FLASHMESSAGE 
7d96  c023  b331  f77e 
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07/30/97  18:15:10  FLASHMESSAGE 
7d96  c023  b331  f77e 


I 


07/30/97  18:15:15  FLASHMESSAGE  I 

7d96  c023  b331  f77e 

07/30/97  18:15:20  FLASHMESSAGE  { 

7d96  c023  b331  f77e 

07/30/97  18:15:25  FLASHMESSAGE  I 

7d96  c023  b331  file 

07/30/97  18:15:25  FLASHMESSAGE  I 

7d96  d923  b331  9274  c558  2248  9274  5058  2248  9274  8d57  2248  9274  d258 
2248  9274  d258  2248  9274  d258  2248  9274  d258  2248  9274  d258  2248  2b7e 

07/30/97  18:15:25  FLASHMESSAGE  { 

7d96  d923  b331  ee7e 


DATA  EXTRACTED  FROM  ADAS  FILE: 

COMMUNICATIONS  DATAPOINTS  CR01  i 


07-30-97  18:15:24 

.  Events : 

0  .  Responses: 

0  . 

DATAPOINT  CMDS 

DISPLAY  NLDN  COMMUNICATIONS  LU  DATAPOINTS 

ALERT  ALARM 

DATAPOINT  NAME  ID  VALUE  CURR  PAST  CURR  PAST  LAST  RESET 


CONNECTION  STATUS: 
NLDN  FAILURES  TOTAL : 
ERROR  DETECTED: 

ERROR  DETECTED  TOTAL: 


01  CFG-ACTIVE 
02  2 
03  0 
04  0 


07-30-97  18:13:21 
07-30-97  18:13:21 
07-30-97  18:13:21 
07-30-97  18:13:21 


07-30-97  18:15:37 

.  Events : 

0  .  Responses: 

0  . 

DATAPOINT  CMDS 

DISPLAY  ITWS  COMMUNICATION  LU  DATAPOINTS 

ALERT  ALARM 


DATAPOINT  NAME 

ID 

VALUE 

CURR  PAST  CURR  PAST  LAST  RESET 

CONNECTION  STATUS: 

01 

CFG-ACTIVE 

*  07-30-97 

18:13:21 

AWOS  MESSAGES  SENT: 

02 

0 

07-30-97 

18:13:21 

AWOS  ADU  MSGS  SENT: 

03 

0 

07-30-97 

18:13:21 
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LDD 

MESSAGES  SENT: 

04 

23 

07-30-97 

18:13:21 

LDD 

ADU  SENT: 

05 

5 

07-30-97 

18:13:21 

ADAS  EVENT  LOG  FILE 

CR01 

EVENT  PRIORITY:  non-critical 

DATE/TIME 

STAMP: 

07-30-97  18:10:42 

EVENT  SEQ.  NUMBER:  43  EVENT 

TYPE:  61 

CSC 

ID:  21.01 

Status  of  the  ITWS  connection  has  changed, 
site  id:  1001 

comm  status:  enabled-failed 

EVENT  PRIORITY:  non-critical  DATE/TIME  STAMP:  07-30-97  18:14:27 
EVENT  SEQ.  NUMBER:  494  EVENT  TYPE:  61  CSC  ID:  21.01 

Status  of  the  ITWS  connection  has  changed. 

site  id:  1001 

comm  status:  enabled-active 

EVENT  PRIORITY:  non-critical  DATE/TIME  STAMP:  07-30-97  18:16:47 
EVENT  SEQ.  NUMBER:  531  EVENT  TYPE:  61  -  CSC  ID:  21.01 

Status  of  the  ITWS  connection  has  changed. 

site  id:  1001 

comm  status:  enabled-failed 


EVENT  PRIORITY:  non-critical  DATE/TIME  STAMP:  07-30-97  18:13:22 
EVENT  SEQ.  NUMBER:  83  EVENT  TYPE:  62  CSC  ID:  22.01 

Status  of  the  NLDN  connection  has  changed. 

comm  status:  enabled-active 

EVENT  PRIORITY:  non-critical  DATE/TIME  STAMP:  07-30-97  18:14:51 
EVENT  SEQ.  NUMBER:  497  EVENT  TYPE:  62  CSC  ID:  22.01 

Status  of  the  NLDN  connection  has  changed. 

comm  status:  enabled-failed 

EVENT  PRIORITY:  non-critical  DATE/TIME  STAMP:  07-30-97  18:15:00 
EVENT  SEQ.  NUMBER:  498  EVENT  TYPE:  62  CSC  ID:  22.01 

Status  of  the  NLDN  connection  has  changed. 

comm  status:  enabled- active 

EVENT  PRIORITY:  non-critical  DATE/TIME  STAMP:  07-30-97  18:16:47 
EVENT  SEQ.  NUMBER:  530  EVENT  TYPE:  62  CSC  ID:  22.01 

Status  of  the  NLDN  connection  has  changed. 

comm  status:  enabled-failed 
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C.1.2.  TEST  AL-01B  -  ALDARS  Interface 


The  following  paragraphs  provide  information  about  data  associated  with  this 
test  but  not  included  within  the  main  body  of  this  report. 


C.1.2.1.  Associated  Evaluation  Criteria  and  Data 

The  following  Evaluation  Criteria  were  used  to  determine  the  requirements 
passed/failed.  The  Cross  Reference  (CR)  numbers  can  be  used  to  trace  into  the 
data  found/referenced  below. 


b. 


c. 


Pass  Fail 

[X]  [  ]  Each  test  procedure  step's  "pass"  box,  in  the  'Observed 

Results'  column,  is  marked,  indicating  the  'Expected 
Response'  was  observed  and/or  the  correct  action  was 
performed  successfully.  (See  Appendix  C  for  the  test 
procedures  performed  for  this  test) . 


[  x]  [  ]  NLDN  to  ADAS  (216  bits  and  667  times/minute) . 

CR01  NAS-SS-1000,  Vol.  II  Table  3 ■ 2 . 1 . 5 . 8 . 3-Tlk  LSS2-024  | 

[  x]  [  ]  The  correct  receipt  of  these  messages  by  the  ITWS 

216  bits  and  667  times/minute) .  CR02  NAS-SS-1000, Vol .  II 
Table  3. 2 .1.5. 8 ,3-Tlll  ISS2-005 


The  following  data,  marked  with  evaluation  criteria  cross-reference  numbers, 
is  a  subset  of  the  OT&E  formal  test  run  data.  Other  relavent  data  has  been 
included  into  test  AL-01B' s  Test  Conduct  Form  (TCF)  file,  "AL-01B. TCF  . 


DATA  EXTRACTED  FROM  IPS 

FILE: 

.  10-06-97  14:34:48 

.  Events :  1 

.  .  Responses  :  0 

.  Message  Output  Cmds  j 

DISPLAY  INPUT  MESSAGE  LOG 


INPUT  MESSAGE:  14 _ CR02  j 

RECEIVE  TIME  (IPS):  10/06/97  14:27:08  j 

RECEIVE  TIME  (ADAS) : 10/06/97  14:27:08  J 

SIMULATOR  ID:  6 

MESSAGE  TYPE:  ITWS1 . LDD.MSG  \ 

MESSAGE  SIZE:  "  182 

GROUP  ID:  14 


HEX  DUMP  OF  TEST  FILE: 


C-ll 


01  Od  Od  Oa  20  20  20  20  20  20  20  20  20  Od  Od  Oa  4c  44  55  53  < 

32  37  20  4b  41  43  59  20  30  36  31  34  32  37  20  00  00  00  Od  Od 

Oa  00  03  7c  c 0  e6  3a  32  db  76  7a  3b  22  48  db  76  87  3b  22  48 

db  76  al  3b  22  48  db  76  6d  3b  22  48  db  76  94  3b  22  48  db  76 

ae  3b  22  48  db  76  bb  3b  22  48  db  76  d5  3b  22  48  db  76  ef  3b 

22  48  db  76  ae  3b  22  48  db  76  c8  3b  22  48  db  76  e2  3b  22  48 

db  76  fc  3b  22  48  db  76  30  3c  22  48  db  76  64  3c  22  48  db  76 

98  3c  22  48  db  76  09  3c  22  48  db  76  4a  3c  22  48  db  76  d9  3c 

22  48  db  76  f3  3c  22  48  £4  cO  e6  3a  32  04  cO  e6  3a  32  Od  Od 

Oa  03  < - - TAIL 


ITWS1  LDP  INPUT  MESSAGE/NLDN  LDP  OUTPUT  MESSAGE: 

. . . .  CR01 


INPUT  MESSAGE  #:  14 


RECEIVE  TIME  (IPS) : 
RECEIVE  TIME  (ADAS) : 
SIMULATOR  ID: 
MESSAGE  TYPE: 
MESSAGE  SIZE: 

GROUP  ID: 

MESSAGE  TYPE:  ITWS1 
HEADER: 

TYPE: 

GEOGRAPHIC  DESIG: 
BULLETIN: 

SITE  ID: 

DAY/HOUR/MINUTE: 
Number  of  Messages 


10/06/97  14:27:08 
10/06/97  14:27:08 
6 

ITWS1  LDP  MSG 
182 
14 

LDD 

0x01 

LD 

US 

27 

KACY 

06/14/27 

3 


LDD  FORMAT  IN  HEXDECIMAL 


LENGTH  INDICATOR 
DATE/TIME  FIELD 
FLASH  RECORD  #01 

:7c 
:  cO 
:db 

e6 

76 

3a 

7a 

32 

3b 

22 

48 

FLASH 

RECORD 

#02 

:  db 

76 

87 

3b 

22 

48 

FLASH 

RECORD 

#03 

:  db 

76 

al 

3b 

22 

48 

FLASH 

RECORD 

#04 

:  db 

76 

6d 

3b 

22 

48 

FLASH 

RECORD 

#05 

:  db 

76 

94 

3b 

22 

48 

FLASH 

RECORD 

#06 

:  db 

76 

ae 

3b 

22 

48 

FLASH 

RECORD 

#07 

:  db 

76 

bb 

3b 

22 

48 

FLASH 

RECORD 

#08 

:  db 

76 

d5 

3b 

22 

48 

FLASH 

RECORD 

#09 

:db 

76 

ef 

3b 

22 

48 

FLASH 

RECORD 

#10 

:  db 

76 

ae 

3b 

22 

48 

FLASH 

RECORD 

#11 

:db 

76 

c8 

3b 

22 

48 

FLASH 

RECORD 

#12 

:db 

76 

e2 

3b 

22 

48 

FLASH 

RECORD 

#13 

:  db 

76 

f  c 

3b 

22 

48 

FLASH 

RECORD 

#14 

:db 

76 

30 

3c 

22 

48 

FLASH 

RECORD 

#15 

:  db 

76 

64 

3c 

22 

48 

FLASH 

RECORD 

#16 

:  db 

76 

98 

3c 

22 

48 

FLASH 

RECORD 

#17 

:  db 

76 

09 

3c 

22 

48 

FLASH 

RECORD 

#18 

:  db 

76 

4a 

3c 

22 

48 

FLASH 

RECORD 

#19 

:  db 

76 

d9 

3c 

22 

48 

FLASH 

RECORD 

#20 

:db 

76 

f  3 

3c 

22 

48 

HEAD 


C-12 


LENGTH  INDICATOR  : 04 
DATE/TIME  FIELD  : cO  e6  3a  32 


LENGTH  INDICATOR  :04 
DATE/TIME  FIELD  :c0  e6  3a  32 
No  more  messages  in  this  ADU 


INPUT  MESSAGE  #:  18 


RECEIVE  TIME  (IPS) : 


10/06/97  14:27:31 


RECEIVE  TIME  (ADAS) 


10/06/97  14:27:31 


SIMULATOR  ID: 
MESSAGE  TYPE: 
MESSAGE  SIZE: 

GROUP  ID: 

MESSAGE  TYPE: 
HEADER: 

TYPE: 

GEOGRAPHIC  DESIG: 
BULLETIN: 

SITE  ID: 

DAY/HOUR/MINUTE: 
Number  of  Messages 


ITWS1  LDD  MSG 


182 

19 


ITWS1  LDD 

0x01 


LD 
US 
27 

KACY 
06/14/27 
3 

LDD  FORMAT  IN  H EXDECIMAL 


LENGTH  INDICATOR 
DATE/TIME  FIELD 


FLASH 

RECORD 

#01 

FLASH 

RECORD 

#02 

FLASH 

RECORD 

#03 

FLASH 

RECORD 

#04 

FLASH 

RECORD 

#05 

FLASH 

RECORD 

#06 

FLASH 

RECORD 

#07 

FLASH 

RECORD 

#08 

FLASH 

RECORD 

#09 

FLASH 

RECORD 

#10 

FLASH 

RECORD 

#11 

FLASH 

RECORD 

#12 

FLASH 

RECORD 

#13 

FLASH 

RECORD 

#14 

FLASH 

RECORD 

#15 

FLASH 

RECORD 

#16 

FLASH 

RECORD 

#17 

FLASH 

RECORD 

#18 

FLASH 

RECORD 

#19 

FLASH 

RECORD 

#20 

LENGTH  INDICATOR 
DATE/TIME  FIELD 


:7c 


:d9 

e6 

3a 

32 

:c7 

76 

6d 

3b 

22 

48 

:b4 

76 

6d 

3b 

22 

48 

:  8c 

76 

6d 

3b 

22 

48 

:  db 

76 

6d 

3b 

22 

48 

:  aO 

76 

6d 

3b 

22 

48 

:  79 

76 

6d 

3b 

22 

48 

:  65 

76 

6d 

3b 

22 

48 

:  3e 

76 

6d 

3b 

22 

48 

:  17 

76 

6d 

3b 

22 

48 

:  7  9 

76 

6d 

3b 

22 

48 

:  51 

76 

6d 

3b 

22 

48 

:2a 

76 

6d 

3b 

22 

48 

:  03 

76 

6d 

3b 

22 

48 

:b4 

75 

6d 

3b 

22 

48 

:  66 

75 

6d 

3b 

22 

48 

:  17 

75 

6d 

3b 

22 

48 

:  ef 

75 

6d 

3b 

22 

48 

:8d 

75 

6d 

3b 

22 

48 

:b5 

74 

6d 

3b 

22 

48 

:  8e 

74 

6d 

3b 

22 

48 

:  04 

:  da 

e6 

3a 

32 

C-13 


LENGTH  INDICATOR  : 04 
DATE/TIME  FIELD  :da  e6  3a  32 
No  more  messages  in  this  ADU 


INPUT  MESSAGE  #: 

RECEIVE  TIME  {IPS 

: 

21 

10/06/97 

14:27:58 

RECEIVE  TIME  (ADAS) : 

10/06/97 

14:27:58 

SIMULATOR 

ID: 

6 

MESSAGE  TYPE: 

ITWS1 

LDD 

MSG 

MESSAGE  SIZE: 

182 

GROUP  ID: 

22 

MESSAGE  TYPE:  ITWS1 

LDD 

HEADER: 

0x01 

TYPE: 

LD 

GEOGRAPHIC 

DESIG: 

US 

BULLETIN: 

27 

SITE  ID: 

KACY 

DAY/HOUR/MINUTE: 

06/14/27  " 

Number  of  Message 

5 

3 

LDD  FORMAT 

IN  HEXDECIMAL 

LENGTH  INDICATOR 

7c 

DATE/TIME  FIELD 

f  3 

e6 

3a 

32 

FLASH  RECORD 

#01 

db 

76 

60 

3b 

22 

48 

FLASH  RECORD 

#02 

db 

76 

53 

3b 

22 

48 

FLASH  RECORD 

#03 

db 

76 

39 

3b 

22 

48 

FLASH  RECORD 

#04 

db 

76 

6d 

3b 

22 

48 

FLASH  RECORD 

#05 

db 

76 

46 

3b 

22 

48 

FLASH  RECORD 

#06 

db 

76 

2c 

3b 

22 

48 

FLASH  RECORD 

#07 

db 

76 

if 

3b 

22 

48 

FLASH  RECORD 

#08 

db 

76 

05 

3b 

22 

48 

FLASH  RECORD 

#09 

db 

76 

eb 

3a 

22 

48 

FLASH  RECORD 

#10 

db 

76 

2c 

3b 

22 

48 

FLASH  RECORD 

#11 

db 

76 

12 

3b 

22 

48 

FLASH  RECORD 

#12 

db 

76 

f  8 

3a 

22 

48 

FLASH  RECORD 

#13 

db 

76 

de 

3a 

22 

48 

FLASH  RECORD 

#14 

db 

76 

aa 

3  a 

22 

48 

FLASH  RECORD 

#15 

db 

76 

76 

3a 

22 

48 

FLASH  RECORD 

#16 

db 

76 

42 

3a 

22 

48 

FLASH  RECORD 

#17 

db 

76 

dl 

3a 

22 

48 

FLASH  RECORD 

#18 

db 

76 

90 

3a 

22 

48 

FLASH  RECORD 

#19 

db 

76 

01 

3a 

22 

48 

FLASH  RECORD 

#20 

db 

76 

e7 

39 

22 

48 

LENGTH  INDICATOR 

:  04 

DATE/TIME  FIELD 

:  f  3 

e6 

3a 

32 

LENGTH  INDICATOR 

:  04 

DATE/TIME  FIELD 

:  f  3 

e6 

3a 

32 

No  more  messages  in  this  ADU 


C-14 


10/06/97  14:27:00  FLASHMESSAGE  I 


7d96 

c0e6 

3a32 

db76  7a3b  2248 

db76 

873b 

2248  ( 

db7 6  a 13b  2248  db76  6d3b 

2248 

db76 

943b 

2248  db76  ae3b 

2248 

db76 

bb3b 

2248 

db76 

d53b 

2248 

db76 

ef  3b 

2248 

db76 

ae3b 

2248 

db76  c83b  2248 

db7  6 

e23b 

2248 

db76 

f  c3b 

2248 

db7  6 

303c 

2248 

db7  6 

643c 

2248 

db76 

983c  2248  db76 

093c 

2248 

db76 

4a3c 

2248 

db76 

d93c 

2248 

db76 

f  33c 

2248 

e87e 

10/06/97  14: 

27:00 

FLASHMESSAGE 

7d96 

c0e6 

3a32 

b87e 

10/06/97  14: 

27:26 

FLASHMESSAGE 

7d96 

d9e6 

3a32 

c776  6d3b  2248 

b47  6 

6d3b 

2248 

8c76  6d3b  2248  db76  6d3b 

2248 

a076 

6d3b 

2248  7976  6d3b 

2248 

6576 

6d3b 

2248 

3e7  6 

6d3b 

2248 

1776 

6d3b 

2248 

7976 

6d3b 

2248 

5176  6d3b  2248 

2a76 

6d3b 

2248 

0376 

6d3b 

2248 

b475 

6d3b 

2248 

6675 

8e74 

6d3b 

2248 

1775 

6d3b  2248  ef75 

6d3b 

2248 

8d75 

6d3b 

2248 

b574 

6d3b 

2248 

6d3b 

2248 

8e7e 

10/06/97  14: 

27:26 

FLASHMESSAGE 

7d96 

dae6 

3a32 

a27e 

10/06/97  14: 

27:51 

FLASHMESSAGE 

7d96 

dae6 

3a32 

a27e 

10/06/97  14: 

:  27 : 51 

FLASHMESSAGE 

7d96 

f  3e6 

3a32 

db7 6  603b  2248 

db7  6 

533b 

2248 

db7 6  393b  2248  db76  6d3b 

2248 

db7  6 

4  63b 

2248  db7 6  2c3b 

2248 

db76 

If  3b 

2248 

db7  6 

053b 

2248 

db7  6 

eb3a 

2248 

db7  6 

2c3b 

2248 

db7 6  123b  2248 

db76 

f  83a 

2248 

db7  6 

de3a 

2248 

db76 

aa3a 

2248 

db76 

763a 

2248 

db7  6 

423a  2248  db76 

dl3a 

2248 

db7  6 

903a 

2248 

db7  6 

013a 

2248 

db7  6 

e739 

2248 

557e 

10/06/97  14 

:  27 : 51 

.  FLASHMESSAGE 

7d96 

f  3e6 

3a32 

8b7e 

DATA  EXTRACTED  FROM  ADAS  FILE: 

COMMUNICATION  CHARACTERISTICS: 

C-15 


10-06-97  14:28:48  .  Events:  0  .  Responses:  0  .  DATAPOINT  CMDS  | 


DISPLAY  NLDN  COMMUNICATIONS  LU  DATAPOINTS 

ALERT  ALARM  . 

DATAPOINT  NAME  ID  VALUE  CURR  PAST  CURR  PAST  LAST  RESET 


CONNECTION  STATUS: 
14:25:41 

01  CFG-ACTIVE 

10-06-97 

NLDN  FAILURES  TOTAL: 

02  7 

10-06-97 

14:25:41 

ERROR  DETECTED: 

03  0 

10-06-97 

14:25:41 

ERROR  DETECTED  TOTAL: 
14:25:41 

04  0 

10-06-97 

ALERT  THRESHOLDS  ALARM  THRESHOLDS 


UPPER 

LOWER 

ENAB 

UPPER 

LOWER 

ENAB 

-1 

-1 

YES 

-1 

2 

YES 

10-06-97  14:29:02 

.  Events :  0  . 

Responses : 

0  . 

DATAPOINT  CMDS 

*  *  • 

DISPLAY 

ITWS  COMMUNICATION  LU 

DATAPOINTS 

DATAPOINT  NAME 

ID 

VALUE 

ALERT 
CURR  PAST 

ALARM 

CURR  PAST 

LAST  RESET 

CONNECTION  STATUS: 

01 

CFG-ACTIVE 

10-06-97 

14:25:41 

AWOS  MESSAGES  SENT 
14:25:41 

02 

30 

10-06-97 

AWOS  ADU  MSGS  SENT 
14:25:41 

03 

2 

10-06-97 

LDD  MESSAGES  SENT: 
14:25:41 

04 

101 

10-06-97 

LDD  ADU  SENT: 
14:25:41 

05 

21 

10-06-97 

ALERT  THRESHOLDS 
UPPER  LOWER  ENAB 

-1  -1  YES 


ALARM  THRESHOLDS 
UPPER  LOWER  ENAB 

-1  2  YES 


ADAS  EVENT  LOG  FILE: 

EVENT  PRIORITY:  non-critical  DATE/TIME  STAMP:  10-06-97  14:25:44 
EVENT  SEQ.  NUMBER:  61  EVENT  TYPE:  62  CSC  ID:  22.01 

Status  of  the  NLDN  connection  has  changed. 

comm  status:  enabled-active 


C-16 


EVENT  PRIORITY:  non-critical  DATE/TIME  STAMP:  10-06-97  14:26:52 
EVENT  SEQ.  NUMBER:  447  EVENT  TYPE:  62  CSC  ID:  22.01 

Status  of  the  NLDN  connection  has  changed. 

comm  status:  enabled-f ailed 

EVENT  PRIORITY:  non-critical  DATE/TIME  STAMP:  10-06-97  14:27:03 
EVENT  SEQ.  NUMBER:  449  EVENT  TYPE:  62  CSC  ID:  22.01 

Status  of  the  NLDN  connection  has  changed. 

comm  status:  enabled-active 

EVENT  PRIORITY:  non-critical  DATE/TIME  STAMP:  10-06-97  14:29:04 
EVENT  SEQ.  NUMBER:  469  EVENT  TYPE:  62  CSC  ID:  22.01 

Status  of  the  NLDN  connection  has  changed. 

comm  status:  enabled-failed 

EVENT  PRIORITY:  non-critical  DATE/TIME  STAMP:  10-06-97  14:29:04 
EVENT  SEQ.  NUMBER:  470  EVENT  TYPE:  62  CSC  ID:  22.01 

Status  of  the  NLDN  connection  has  changed. 

comm  status:  enabled-active 

EVENT  PRIORITY:  non-critical  DATE/TIME  STAMP:  10-06-97  14:31:05 
EVENT  SEQ.  NUMBER:  486  EVENT  TYPE:  62  CSC  ID:  22.01 

Status  of  the  NLDN  connection  has  changed. 

comm  status:  enabled-failed 


EVENT  PRIORITY:  non-critical  DATE/TIME  STAMP:  10-06-97  14:24:10 
EVENT  SEQ.  NUMBER:  44  EVENT  TYPE:  61  CSC  ID:  21.01 

Status  of  the  ITWS  connection  has  changed. 

site  id:  1001 

comm  status:  enabled-failed 

EVENT  PRIORITY:  non-critical  DATE/TIME  STAMP:  10-06-97  14:25:18 
EVENT  SEQ.  NUMBER:  50  EVENT  TYPE:  61  CSC  ID:  21.01 

Status  of  the  ITWS  connection  has  changed. 

site  id:  1001 

comm  status:  enabled-active 

EVENT  PRIORITY:  non-critical  DATE/TIME  STAMP:  10-06-97  14:30:58 
EVENT  SEQ.  NUMBER:  483  EVENT  TYPE:  61  CSC  ID:  21.01 

Status  of  the  ITWS  connection  has  changed. 

site  id:  1001 

comm  status:  enabled-failed 


C-17 
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To  log  into  IUC  enter:  The  state  of  the  IPS  application  is  displayed,  [X]  Pass  [  ]  Fail  Stop  Test 

login:  "aldars"  followed  by  the  ’aldars’  prompt, 

password:  "me tar 1" 


TEST  ID:  AL-01B  TEST  OPERATOR:  _ HUGH  H.  VUONG _  DATE:  10_/06_/_97  TIME:  _14:26_  TEST  DIRECTOR’S  INITIALS 
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23.  @ISC  ISI:  wait  for  the  IPS  clock  displays  @  45-50  secs  Acknowledge  event  (start  of  the  lightning  [X]  Pass  [  ]  Fail  Stop  Test 

of  the  next  mission  cycle.  Select  [F7]  .  script  file). 


TEST  ID:  AL-01B  TEST  OPERATOR:  _ HUGH  H.  VUONG _  DATE:  10  /06  /  97  TIME:  14:26  TEST  DIRECTOR'S  INITIALS 
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36.  @ISI:  Output  the  NLDN  LDD  Output  Outgoing  Message  Log  The  specified  log  is  output  to  the  ’/tmp'  [X]  Pass  [  ]  Fail  Stop  Test 

(OML)  to  file.  " [F8]  AL-01B  [RETURN]  [RETURN]  [SPACE]  directory. 

[RETURN]  [N]  [RETURN]  (wait)  [F14]  [F14]  [F14]"  The  Output  Message  Log  Screen  is  displayed. 
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C.1.3.  TEST  AL-01C  -  ALDARS  Interface 

The  following  paragraphs  provide  information  about  data  associated  with  this 
test  but  not  included  within  the  main  body  of  this  report. 


C.1.3.1.  Associated  Evaluation  Criteria  and  Data 

The  following  Evaluation  Criteria  were  used  to  determine  the  requirements 
passed/failed.  The  Cross  Reference  (CR)  numbers  can  be  used  to  trace  into  the 
data  found/referenced  below. 

Pass  Fail 


a-  [xx]  [  ]  Each  test  procedure  step's  "pass"  box,  in  the  'Observed 

Results'  column  is  marked,  indicating  the  'Expected 
Response'  was  observed  and/or  the  correct  action  was 
performed  successfully.  (See  Appendix  C  for  the  test 
procedures  performed  for  this  test). 

b.  [xx]  [  ]  NLDN  to  ADAS  (216  bits  and  667  times/minute)  .  CR01  NAS-SS- 

1000,  Vol .  II  Table  3 . 2 . 1 . 5 ■ 8 . 3-Tlk  LSS2-024 

C.  [xx]  [  ]  The  correct  receipt  of  these  messages  by  the  ITWS  (216  bits 

and  667  times/minute).  CR02  NAS-SS-1000,  Vol .  II  Table 
3 . 2 . 1 . 5 ■ 8 . 3-T111  ISS2-005 

d.  [xx]  [  ]  ADAS  support  data  collection  from  NLDN.  CR03  NAS-SS- 

1000, Vol.  II  3 . 2 . 1 . 5 . 8-2a  LSS2-002. 


The  following  data,  marked  with  evaluation  criteria  cross-reference  numbers, 
is  a  subset  of  the  OT&E  formal  test  run  data.  Other  relavent  data  has  been 
included  into  test  AL-OlC's  Test  Conduct  Form  (TCF)  file,  "AL-01C.TCF". 


DATA  EXTRACTED  FROM  IPS  FILE: 


07-30-97  19:38:52  .Events:  2  .  Responses:  0  .  Message  Output  Cmds 


DISPLAY  INPUT  MESSAGE  LOG 

INPUT  MESSAGE:  19 _ _ _ CR02 

RECEIVE  TIME  (IPS):  07/30/97  19:35:06 
RECEIVE  TIME  (ADAS ): 07/30/97  19:35:06 
SIMULATOR  ID:  6 
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MESSAGE  TYPE:  ITWSl . LDD.MSG 

MESSAGE  SIZE:  110 

GROUP  ID:  19 

HEX  DUMP  OF  TEST  FILE: 

01  Od  Od  Oa  20  20  20  20  20  20  20  20  20  Od  Od  Oa  4c  44  55  53 

30  31  20  41  43  54  59  20  33  30  31  39  33  35  20  00  00  00  Od  Od 

Oa  00  03  34  cO  38  b3  31  a9  74  d2  58  22  48  77  75  d2  58  22  48 

ce  76  d2  58  22  48  92  74  d2  58  22  48  92  74  d2  58  22  48  92  74 

d2  58  22  48  92  74  d2  58  22  48  92  74  d2  58  22  48  04  cO  38  b3 

31  04  cO  38  b3  31  Od  Od  Oa  03 


ITWSl  LDP  INCOMMING  MESSAGE 


CR01 


INPUT  MESSAGE  #:' 


19 


RECEIVE  TIME  (IPS) : 

RECEIVE  TIME  (ADAS) : 

SIMULATOR  ID: 

MESSAGE  TYPE: 

MESSAGE  SIZE: 

GROUP  ID: 

MESSAGE  TYPE:  ITWSl  LDD 
HEADER:  0x01 

TYPE:  LD 

GEOGRAPHIC  DESIG:  US 

BULLETIN:  01 

SITE  ID:  ACTY 

DAY/HOUR/MINUTE:  30/19/35 

Number  of  Messages  3 

LDD  FORMAT  IN  HEXDECIMAL 


07/30/97  19:35:06 
07/30/97  19:35:06 
6 

ITWS1_LDD_MSG 

110 

19 


LENGTH  INDICATOR 
DATE/TIME  FIELD 
FLASH  RECORD  #01 
FLASH  RECORD  #02 
FLASH  RECORD  #03 
FLASH  RECORD  #04 
FLASH  RECORD  #05 
FLASH  RECORD  #06 
FLASH  RECORD  #07 
FLASH  RECORD  #08 


LENGTH  INDICATOR 
DATE/TIME  FIELD 


34 


cO 

38 

b3 

31 

a9 

74 

d2 

58 

22 

48 

77 

75 

d2 

58 

22 

48 

ce 

76 

d2 

58 

22 

48 

92 

74 

d2 

58 

22 

48 

92 

74 

d2 

58 

22 

48 

92 

74 

d2 

58 

22 

48 

92 

74 

d2 

58 

22 

48 

92 

74 

d2 

58 

22 

48 

04 

cO 

38 

b3 

31 

LENGTH  INDICATOR  : 04 
DATE/TIME  FIELD  : cO  38  b3  31 
No  more  messages  in  this  ADU 


INPUT  MESSAGE  #:  20 
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RECEIVE  TIME  (IPS) : 

RECEIVE  TIME  (ADAS): 

SIMULATOR  ID: 

MESSAGE  TYPE: 

MESSAGE  SIZE: 

GROUP  ID: 

MESSAGE  TYPE:  ITWSl  LDD 
HEADER:  0x01 

TYPE:  LD 

GEOGRAPHIC  DESIG:  US 

BULLETIN:  01 

SITE  ID:  ACTY 

DAY/HOUR/MINUTE:  30/19/35 

Number  of  Messages  1 

LDD  FORMAT  IN  HEXDECIMAL 


07/30/97  19:35:11 
07/30/97  19:35:11 
6 

ITWS1_LDD_MSG 

52 

20 


LENGTH  INDICATOR  :04 
DATE/TIME  FIELD  : cO  38  b3  31 
No  more  messages  in  this  ADU 


INPUT  MESSAGE  #: 

RECEIVE  TIME  (IPS) : 
RECEIVE  TIME  (ADAS) 
SIMULATOR  ID: 
MESSAGE  TYPE: 
MESSAGE  SIZE: 

GROUP  ID: 

MESSAGE  TYPE 
HEADER: 

TYPE: 

GEOGRAPHIC  DESIG: 
BULLETIN: 

SITE  ID: 

DAY/HOUR/MINUTE : 


21 

07/30/97  19:35:21 
07/30/97  19:35:21 


6 

ITWS1_LDD_MSG 
57 
22 

ITWSl  LDD 

0x01 
LD 
US 


01 

ACTY 

30/19/35 


:  04 

: cO  38  b3  31 


Number  of  Messages  2 

LDD  FORMAT  IN  HEXDECIMAL 

LENGTH  INDICATOR 
DATE/TIME  FIELD 


LENGTH  INDICATOR  :04 
DATE/TIME  FIELD  :c0  38  b3  31 
No  more  messages  in  this  ADU 


INPUT  MESSAGE  #: 

RECEIVE  TIME  (IPS) : 
RECEIVE  TIME  (ADAS) : 
SIMULATOR  ID: 
MESSAGE  TYPE: 
MESSAGE  SIZE: 


22 

07/30/97  19:35:31 
07/30/97  19:35:31 
6 

ITWS1_LDD_MSG 

110 
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GROUP  ID:  23 

MESSAGE  TYPE:  ITWS1  LDD 
HEADER:  0x01 

TYPE:  LD 

GEOGRAPHIC  DESIG:  US 

BULLETIN:  01 

SITE  ID:  ACTY 

DAY/HOUR/MINUTE :  30/19/35 

Number  of  Messages  3 


LDD  FORMAT  IN  HEXDECIMAL 


LENGTH 

:  INDICATOR  : 

:  04 

DATE/TIME  FIELD  : 

:  cO 

38 

b3 

31 

LENGTH 

:  INDICATOR  : 

34 

DATE/TIME  FIELD  : 

da 

38 

b3 

31 

FLASH 

RECORD 

#01 

92 

74 

c5 

58 

22 

48 

FLASH 

RECORD 

#02 

92 

74 

50 

58 

22 

48 

FLASH 

RECORD 

#03 

92 

74 

8d 

57 

22 

48 

FLASH 

RECORD 

#04 

92 

74 

d2 

58 

22 

48 

FLASH 

RECORD 

#05 

92 

74 

d2 

58 

22 

48 

FLASH 

RECORD 

#06 

92 

74 

d2 

58 

22 

48 

FLASH 

RECORD 

#07 

92 

74 

d2 

58 

22 

48 

FLASH 

RECORD 

#08 

92 

74 

d2 

58 

22 

48 

LENGTH 

:  INDICATOR  : 

:  04 

DATE/TIME  FIELD  : 

:  00 

00 

00 

00 

No  more  messages  in  this  ADU 


INPUT  MESSAGE  #: 


23 


RECEIVE  TIME  (IPS) 
RECEIVE  TIME  (ADAS 
SIMULATOR  ID: 
MESSAGE  TYPE: 
MESSAGE  SIZE: 

GROUP  ID: 

MESSAGE  TYPE: 
HEADER: 

TYPE: 

GEOGRAPHIC  DESIG: 
BULLETIN: 

SITE  ID: 

DAY/HOUR/MINUTE : 
Number  of  Messages 


07/30/97  19:35:36 
07/30/97  19:35:36 
6 

ITWS1_LDD_MSG 

52 

24 


ITWS1  LDD 

0x01 


LD 

US 

01 

ACTY 

30/19/35 

1 


LDD  FORMAT  IN  HEXDECIMAL 


LENGTH  INDICATOR  :04 
DATE/TIME  FIELD  :da  38  b3  31 
No  more  messages  in  this  ADU 


INPUT  MESSAGE  #:  24 
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RECEIVE  TIME  (IPS) : 
RECEIVE  TIME  (ADAS) : 
SIMULATOR  ID: 
MESSAGE  TYPE: 

MESSAGE  SIZE: 

GROUP  ID: 

MESSAGE  TYPE:  ITWS1 
HEADER: 


07/30/97  19:35:41 
07/30/97  19:35:41 
6 

ITWS 1_LDD_MSG 
57 
25 
D 

0x01 


TYPE:  LD 

GEOGRAPHIC  DESIG:  US 

BULLETIN:  01 

SITE  ID:  ACTY 

DAY/HOUR/MINUTE:  30/19/35 

Number  of  Messages  2 


LDD  FORMAT  IN  HEXDECIMAL 


LENGTH  INDICATOR  : 04 
DATE/TIME  FIELD  :da  38  b3  31 


LENGTH  INDICATOR  : 04 
DATE/TIME  FIELD  :da  38  b3  31 
No  more  messages  in  this  ADU 


INPUT  MESSAGE  #: 


25 


RECEIVE  TIME  (IPS) : 
RECEIVE  TIME  (ADAS) 
SIMULATOR  ID: 
MESSAGE  TYPE: 
MESSAGE  SIZE: 

GROUP  ID: 

MESSAGE  TYPE: 
HEADER: 

TYPE: 

GEOGRAPHIC  DESIG: 
BULLETIN: 

SITE  ID: 

DAY/HOUR/MINUTE: 
Number  of  Messages 


07/30/97  19:35:51 
07/30/97  19:35:51 
6 

ITWS1_LDD_MSG 

57 

26 


ITWS1  LDD 

0x01 


LD 

US 

01 

ACTY 

30/19/35 

2 


LDD  FORMAT  IN  HEXDECIMAL 


LENGTH  INDICATOR  :04 
DATE/TIME  FIELD  :da  38  b3  31 


LENGTH  INDICATOR  :04 
DATE/TIME  FIELD  :da  38  b3  31 
No  more  messages  in  this  ADU 


INPUT  MESSAGE  #:  26 

RECEIVE  TIME  (IPS):  07/30/97  19:35:56 
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ITWS1  LDD 

0x01 


RECEIVE  TIME  (ADAS) 
SIMULATOR  ID: 

MESSAGE  TYPE: 

MESSAGE  SIZE: 

GROUP  ID: 

MESSAGE  TYPE: 

HEADER: 

TYPE: 

GEOGRAPHIC  DESIG: 
BULLETIN: 

SITE  ID: 

DAY/HOUR/MINUTE:  _ 

Number  of  Messages  2 

LDD  FORMAT  IN  HEXDECIMAL 


07/30/97  19:35:56 
6 

ITWS 1_LDD_MSG 
105 
27 


LD 

US 

01 

ACTY 

30/19/35 


LENGTH  INDICATOR 
DATE/TIME  FIELD 
FLASH  RECORD  #01 
FLASH  RECORD  #02 
FLASH  RECORD  #03 
FLASH  RECORD  #04 
FLASH  RECORD  #05 
FLASH  RECORD  #06 
FLASH  RECORD  #07 
FLASH  RECORD  #08 


LENGTH  INDICATOR 
DATE/TIME  FIELD 
No  more  messages 


34 


f  3 

38 

b3 

31 

7b 

74 

d2 

58 

22 

48 

ad 

73 

d2 

58 

22 

48 

55 

72 

d2 

58 

22 

48 

92 

74 

d2 

58 

22 

48 

92 

74 

d2 

58 

22 

48 

92 

74 

d2 

58 

22 

48 

92 

74 

d2 

58 

22 

48 

92 

74 

d2 

58 

22 

48 

:  04 

:  f  3  38  b3  31 
in  this  ADU 


NLDN  LDD  OUTGOING  MESSAGE  CR01 

07/30/97  19:35:00  FLASHMESSAGE 


7d96  c038 

b331  a974  d258 

2248 

7775 

d258 

2248 

cel  6 

d258 

2248 

9274 

d258 

2248  9274 

d258  2248  9274 

d258 

2248 

9274 

d258 

2248 

9274 

d258 

2248 

6d7e 

07/30/97  19 

:  35 : 00  OTHER 

7dl6  0000 

0000  107d  107e 

1010 

1010 

1010 

1010 

157e 

07/30/97  19_ 

:  35 : 00  FLASHMESSAGE 

7d96  c038  b331  ec7e 

07/30/97  19:35:05  FLASHMESSAGE 
7d96  c038  b331  ec7e 

07/30/97  19:35:10  FLASHMESSAGE 
7d96  c038  b331  fec7e 

07/30/97  19:35:15  FLASHMESSAGE 
7d96  c038  b331  ec7e 

07/30/97  19:35:20  FLASHMESSAGE 
7d96  c038  b331  ec7e 

07/30/97  19:35:26  FLASHMESSAGE 
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7d96  c038  b331  ec7e 
07/30/97  19:35:26  FLASHMESSAGE 

7d96  da38  b331  9274  c558  2248  9274  5058  2248  9274  8d57  2248  9274  d258 
2248  9274  d258  2248  9274  d258  2248  9274  d258  2248  9274  d258  2248  337e 

07/30/97  19:35:26  FLASHMESSAGE 

7d96  0000  1010  1010  107d  107e  1010  1010  1010  157e 

07/30/97  19:35:26  FLASHMESSAGE 

7d96  0000  0000  107d  107e  1010  1010  1010  0085  7e20 

07/30/97  19:35:26  FLASHMESSAGE 
7d96  da38  b331  f67e 

07/30/97  19:35:31  FLASHMESSAGE 
7d96  da38  b331  f67e 

07/30/97  19:35:36  FLASHMESSAGE 
7d96  da38  b331  f67e 

07/30/97  19:35:41  FLASHMESSAGE 
7d96  da38  b331  f67e 

07/30/97  19:35:46  FLASHMESSAGE 
7d96  da38  b331  f67e 

07/30/97  19:35:51  FLASHMESSAGE 
7d96  da38  b331  f67e 

07/30/97  19:35:51  FLASHMESSAGE 


7d96  f 338 

b331 

7b7 4  d258  2248 

ad73 

d258 

2248 

5572 

d2  58 

2248 

9274 

d258 

2248  9274 

d258 

2248  9274  d258 

2248 

9274 

d258 

2248 

9274 

d258 

2248 

cf  7e 

07/30/97  19: 

:  35 : 51 

FLASHMESSAGE 

7d96  0000 

0010 

1010  7dl0  7el0 

1010 

1010 

1010 

957e 

07/30/97  19: 

:  35 : 51 

FLASHMESSAGE 

7d96  f 338  b331  df7e 


DATA  EXTRACTED  FROM  ADAS  FILE: 

COMMUNICATIONS  DATAPOINTS  CR01 


.  07-30-97  19:36:10  .  Events:  1  .  Responses:  0  .  DATAPOINT  CMDS 


DISPLAY  NLDN  COMMUNICATIONS  LU  DATAPOINTS 

ALERT  ALARM 

DATAPOINT  NAME  ID  VALUE  CURR  PAST  CURR  PAST  LAST  RESET 
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CONNECTION  STATUS: 

01 

CFG-ACTIVE 

07-30-97 

19:32:58 

NLDN  FAILURES  TOTAL: 

02 

13 

07-30-97 

19:32:58 

ERROR  DETECTED: 

03 

3 

07-30-97 

19:32:58 

ERROR  DETECTED  TOTAL: 

04 

3 

07-30-97 

19:32:58 

07-30-97  19:36:24 

Events:  4  . 

Responses:  0  . 

DATAPOINT  CMDS 

DISPLAY 

ITWS  COMMUNICATION  LU  DATAPOINTS 

ALERT  ALARM 

DATAPOINT  NAME 

ID 

VALUE 

CURR  PAST  CURR  PAST 

LAST 

RESET 

CONNECTION  STATUS: 

01 

CFG-ACTIVE 

07-30-97 

19:32:58 

07-30-97 

AWOS  MESSAGES  SENT: 

02 

30 

19:32:58 

07-30-97 

AWOS  ADU  MSGS  SENT: 

03 

2 

19:32:58 

07-30-97 

LDD  MESSAGES  SENT: 

04 

107 

19:32:58 

LDD  ADU  SENT: 

05 

27 

07-30-97 

19:32:58 

ADAS  EVENT  LOG  FILE 

CR01 

EVENT  PRIORITY:  non-critical 

DATE/TIME 

STAMP:  07-30-97  19:35 

02 

EVENT  SEQ.  NUMBER:  493 

EVENT  TYPE:  21 

CSC  ID:  11.02 

An  erroneous  message  has 

been 

triggered  by 

System  Logging . 

message  type:  ADAS  received  error  message 

error  type:  NLDN  error  message  error  code:  Invalid  message  type  | 

original  esc  id:  22.01  error  number:  1 
error  offset:  0 

EVENT  PRIORITY:  non-critical  DATE/TIME  STAMP:  07-30-97  19:35:29  | 

EVENT  SEQ.  NUMBER:  500  EVENT  TYPE:  21  CSC  ID:  11.02 

An  erroneous  message  has  been  triggered  by  System  Logging. 

message  type:  ADAS  received  error  message 

error  type:  NLDN  error  message  error  code:  Invalid  checksum  | 

original  esc  id:  22.01  error  number:  2 
error  offset:  30 

EVENT  PRIORITY:  non-critical  DATE/TIME  STAMP:  07-30-97  19:35:29 
EVENT  SEQ,  NUMBER:  501  EVENT  TYPE:  21  CSC  ID:  11.02 

An  erroneous  message  has  been  triggered  by  System  Logging. 

message  type:  ADAS  received  error  message 

error  type:  NLDN  error  message  error  code:  Invalid  SOP-EOP  sequence  | 
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original  esc  id:  22.01  error  number:  3 
error  offset:  80 

EVENT  PRIORITY:  non-critical  DATE/TIME  STAMP:  07-30-97  19:35:55 
EVENT  SEQ.  NUMBER:  504  EVENT  TYPE:  21  CSC  ID:  11.02 

An  erroneous  message  has  been  triggered  by  System  Logging. 

message  type:  ADAS  received  error  message 

error  type:  NLDN  error  message  error  code:  Invalid  DLE  seguence 
original  esc  id:  22.01  error  number:  4 
error  offset:  119 

EVENT  PRIORITY:  non-critical  DATE/TIME  STAMP:  07-30-97  19:36:20 
EVENT  SEQ.  NUMBER:  517  EVENT  TYPE:  21  CSC  ID:  11.02 

An  erroneous  message  has  been  triggered  by  System  Logging. 

message  type:  ADAS  received  error  message 

error  type:  NLDN  error  message  error  code:  Invalid  checksum 
original  esc  id:  22.01  error  number:  5 
error  offset:  169 

EVENT  PRIORITY:  non-critical  DATE/TIME  STAMP:  07-30-97  19:36:20 
EVENT  SEQ.  NUMBER:  518  EVENT  TYPE:  21  CSC  ID:  11.02 

An  erroneous  message  has  been  triggered  by  System  Logging. 

message  type:  ADAS  received  error  message 

error  type:  NLDN  error  message  error  code:  Invalid  SOP  sequence 
original  esc  id:  22.01  error  number:  6 
error  offset:  219 

EVENT  PRIORITY:  non-critical  DATE/TIME  STAMP:  07-30-97  19:30:29 
EVENT  SEQ.  NUMBER:  44  EVENT  TYPE:  61  CSC  ID:  21.01 

Status  of  the  ITWS  connection  has  changed. 

site  id:  1001 

comm  status:  enabled-f ailed 

EVENT  PRIORITY:  non-critical  DATE/TIME  STAMP:  07-30-97  19:33:17 
EVENT  SEQ.  NUMBER:  100  EVENT  TYPE:  61  CSC  ID:  21.01 

Status  of  the  ITWS  connection  has  changed. 

site  id:  1001 

comm  status:  enabled-active 

EVENT  PRIORITY:  non-critical  DATE/TIME  STAMP:  07-30-97  19:36:49 
EVENT  SEQ.  NUMBER:  520  EVENT  TYPE:  61  CSC  ID:  21.01 

Status  of  the  ITWS  connection  has  changed. 

site  id:  1001 

comm  status:  enabled-failed 


EVENT  PRIORITY:  non-critical  DATE/TIME  STAMP:  07-30-97  19:33:00 
EVENT  SEQ.  NUMBER:  83  EVENT  TYPE:  62  CSC  ID:  22.01 

Status  of  the  NLDN  connection  has  changed. 

comm  status:  enabled-active 
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EVENT  PRIORITY:  non-critical  DATE/TIME  STAMP:  07-30-97  19:34:51 
EVENT  SEQ.  NUMBER:  490  EVENT  TYPE:  62  CSC  ID:  22.01 

Status  of  the  NLDN  connection  has  changed. 

comm  status:  enabled-failed 

EVENT  PRIORITY:  non-critical  DATE/TIME  STAMP:  07-30-97  19:35:02 
EVENT  SEQ.  NUMBER:  492  EVENT  TYPE:  62  CSC  ID:  22.01 

Status  of  the  NLDN  connection  has  changed. 

comm  status:  enabled-active 

EVENT  PRIORITY:  non-critical  DATE/TIME  STAMP:  07-30-97  19:35:39 
EVENT  SEQ.  NUMBER:  502  EVENT  TYPE:  62  CSC  ID:  22.01 

Status  of  the  NLDN  connection  has  changed. 

comm  status:  enabled-failed 

EVENT  PRIORITY:  non-critical  DATE/TIME  STAMP:  07-30-97  19:35:39 
EVENT  SEQ.  NUMBER:  503  EVENT  TYPE:  62  CSC  ID:  22.01 

Status  of  the  NLDN  connection  has  changed. 

comm  status:  enabled-active 

EVENT  PRIORITY:  non-critical  DATE/TIME  STAMP:  07-30-97  19:36:49 
EVENT  SEQ.  NUMBER:  521  EVENT  TYPE:  62  CSC  ID:'  22.01 

Status  of  the  NLDN  connection  has  changed. 

comm  status:  enabled-failed 
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C.1.3.2.  TCF  Test  Procedure  Steps 


T5 

O 

x: 

-p 

<D 

2 

CO 

co 
>1 
I — I 
f0 

C 

< 

T5 

C 

f0 

c 

o 

*H 

-P 

O 

P 

T5 

<D 

ca  v* 

4J  k 

(U  CJ 

Q  E-» 

W  6 
H 
4->  O 
CO  I 
Q) 

4->  < 

to 

•H  O 

4J  *H 

m 


O  0> 

* -3 

m  a) 

*  o 

to  ° 
•H  £1, 
M 

a)  jj 

-P  M 

H  -fj 


c  o 

o  p 
•h  m 

•p 

(0  X) 
d  qj 
■H  4J 

m  a 

>  (C 

a)  m 


o 

M  Cu 

w 

_  M 

a  m 


-H 

x: 

-p 


Cl— I 

u  ° 

P 


>1 

X5 

O 

XI 


T5 

Q) 

O 
O 

^  .5 

M  ® 

5  5 

&>  ^ 

c  c 

's  'H 
o  £ 

' — I  Q, 
' — l  rd 

o  M 

IX  tJ1 

to 

(L)  P 

x:  aj 

h  a 


co 

p 


a; 

o 

£h 

CJ 

W 

os 


Eh 

CO 

w 

E-* 


W 

S 


w 

H 

g 


CP 

§ 


4-1 

>1 

x 

32 

XI 

a) 

d) 

K 

T3 

o 

0) 

U 

u 

cu 

D 

32 

C 

a> 

u 

*» 

Q) 

4J 

m 

u 

OS 

o 

Eh 

s 

U 

04 

o 

Eh 

CO 

W 

Eh 


© 

I 


Eh 

CO 

W 

Eh 


«1) 

<p 

a) 

rH 

X 

to 

u 

P 

to 

G) 

Eh 

rH 

43 

05 

O 

rH 

43 

03 

U 

p 

CO 

<p 

Eh 

p 

CO 

a> 

Eh 

p 

u 

CP 

CO 

G 

a 

o 

p 

CO 

P 

u 

(P 

CO 

c 

P 

M 

CP 

(0 

C 

& 

O 

P 

CO 

a 

o 

p 

CO 

<P  G 

S  S 


CM 

U 

04 

I 

04 

CO 

04 

a) 

42 

p 

o 

p 

p 

M 

0 

a 

04 

w 

CO 

a) 

42 

P 


<u 

42 

u 

p 

03 

CU 


CO 

o< 


0 

43 

P 

a> 

M 

G 

P 

ra  ai 

U-H 


1M 


o 

P  H 

H 
TJ  O 
CP  CO 

M  < 

G 

Cn  co 

*h  o 

P  D 
G 

O  G 

U 

O 
CO  £ 
•H  H 


rH  _p 


P  H 
M 

TJ  ° 

Is 

■!§ 

iT!  D 


CM  4J 

y  G 


G 
0)  P 
42  G 
Eh  X3 


U 

H 

O 


co 

p 

u 

CD 


u  = 
H  g 
©  o 
I  u 


i  r 


u  . 

•rH  Q) 

T3  M 

1  H 

a)  ® 

0  0 

id  id 

*  H 

G)  p 

3h  a 

M 

&  & 

CO  w 

a)  o 

rH 

id  id 

43  03 

03  P 

U  03 

p  P 

•3  5 

i  i 

45 

Q.  Q. 

U  M 

id  Jo 

P  o 

0  0 

03  MH 

a 

CM 

p 

CO 

<p 

Eh 

a 

o 

p 

co 


CO 

<u 

Eh 

a 

o 

p 

co 


rH 

rH 

rH 

rH 

rH 

rH 

rH 

rH 

■H 

•H 

•H 

•H 

•H 

•H 

•H 

•H 

03 

03 

G 

G 

G 

G  . 

G 

G 

t4 

Uj 

txj 

[X4 

fc4  - 

tH 

f*4 

[14 

*-■ 

r-r 

r—i 

r-n 

r-t 

*“* 

— 

1—4 

to 

to 

« 

G 

W 

CO 

CO 

CO 

to 

to 

to 

CO 

CO 

CO 

CO 

CO 

03 

G 

G 

G 

G 

G 

G 

G 

04 

04 

O. 

04 

04 

04 

04 

04 

r_ , 

r— , 

r_, 

r—i 

r-i 

a 

>< 

2, 

X 

X 

X 

X 

X 

o 

G 

a; 

p 

03 

o 

•H 

T3 

C 


G 

O 

42 

10 

>i 

03 

i-H 

Q* 

CO 

•H 

Q 


CO  - 

< 

Q  <P 

<  42 


0)  ^ 
42  W 
P  TJ 

% 

p  9 


O 

P 

<U 

ra  -a 

P  P 

CO  >i 
05 
rH 

a 
a;  to 
42  -H 
Eh  T5 


JH 

03 

p 

G 

a) 


fO 

CM 


G  O 

o  o 


a) 

Eh 

a 

o 

p 

CO 


03 

04 


03 

04 


CO 

CO 

G) 

< 

•H 

42 

a 

H 

< 

U 

the 

D 

M 

0) 

G 

4J  (X 

O 

0) 

42 

g  e 

TJ 

P 

U  o 

P 

u 

-H  M 

G 

G 

G 

r— i  a 

42 

P  • 

O 

rH 

to 

a  <p 

G  rH 

42 

a- 

G  W 

>i 

CJ  *H 

to 

G 

U 

G 

P 

rs 

G 

T3 

rrt 

03  £ 
O'  &■ 

u  g 


C  c 

03  .H 
CO  o 

o  rH 
p  - 
03 

U  03 
•H 

T3  W 
G  >1 
•H  03 

i — I 
C3 

y  co 

§3 

0)  u 

42  CO 
Eh  rfj 


O  « 

P  ^ 

<  =  T3 
0)  (0 
0  03  = 
P  ■D 
G  03 
•H  =  T3 
3-) 

O'  ..  o 
o  C  5 

rH  -H  CO 
O'  CO 
O  O  03 
Eh  H  &, 


P 

CO 

Q) 

Eh 

a 

O 

P 

CO 


03 


CO 

CO 

03 

04 


•o 

Q) 

>i 

03 

rH 

a 

CO 

•iH 

*0 


G  . 

2  ^ 

•H  £V 

P  6 

?j  O 

2  M 

•H  Q. 

rH  ^ 

a. 

2*  w 
to  M 

03 

CO  T3 
04  ,H 
M  fO 

0)  ” 

o  >, 

P  T3 

to  0) 
p  s 
to  o 

■ — i 
CD  rH 
42  O 
Eh  P 


-H  C  723 


C-32 


11.  If  IPS  is  not  shutdown  then  ->  @IUC  'aldars'  prompt:  The  ISI  shuts-down  and  the  ISC  displays  a  [X]  Pass  [  ]  Fail  Stop  Test 

Issue  the  command  to  Shutdown  the  IPS.  "stop_ips  'login'  prompt. 
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C.1.4.  TEST  AL-01D  -  ALDARS  Interface 


The  following  paragraphs  provide  information  about  data  associated  with  this 
test  but  not  included  within  the  main  body  of  this  report. 


C.1.4.1.  Associated  Evaluation  Criteria  and  Data 

The  following  Evaluation  Criteria  were  used  to  determine  the  requirements 
passed/failed.  The  Cross  Reference  (CR)  numbers  can  be  used  to  trace  into  the 
data  found/referenced  below. 


Pass  Fail 


txxl  t  ]  Each  test  procedure  step's  "pass"  box,  in  the  'Observed 
Results'  column  is  marked,  indicating  the  ’Expected 
Response'  was  observed  and/or  the  correct  action  was 
performed  successfully.  (See  Appendix  C  for  the  test 
procedures  performed  for  this  test) . 

[xx]  t  ]  NLDN  to  ADAS  (1200  baud,  RS-232  cable)  .  CR01  NAS-SS-1000, 
Vol  II  Figure  3 . 2 . 1 . 5 ■ 8 . 3-Flk  LSS2-022 . 

[xx]  [  ]  NLDN  to  ADAS  (216  bits  and  667  times/minute)  .  CR02  NAS-SS- 
1000,  Vol.  II  Table  3 . 2 . 1 ■ 5 . 8 . 3-Tlk  LSS2-024 

[xx]  [  ]  The  correct  receipt  of  these  messages  by  the  ITWS  (216  bits 

and  667  times/minute) . CR03  NAS-SS-1000, Vol .  II  Table 
3.2. 1.5. 8.3-T111  ISS2-005 


The  following  data,  marked  with  evaluation  criteria  cross-reference  numbers, 
is  a  subset  of  the  OT&E  formal  test  run  data.  Other  relavent  data  has  been 
included  into  test  AL-OlD's  Test  Conduct  Form  (TCF)  file,  "AL-01D . TCF" . 


DATA  EXTRACTED  FROM  IPS  FILE: 


.  08  11  97  13:36:06  .  Events:  2  .  Responses:  0  .  Message  Output  Cmds 


DISPLAY  INPUT  MESSAGE  LOG 
INPUT  MESSAGE:  17 

RECEIVE  TIME  (IPS):  08/11/97  13:23:57  CR02 

RECEIVE  TIME  (ADAS) : 08/11/97  13:23:57 
SIMULATOR  ID:  6 
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MESSAGE  TYPE: 
MESSAGE  SIZE: 
GROUP  ID: 


HEX  DUMP  OF  TEST  FILE:  CR03 


01 

Od 

Od 

0a 

20 

20 

20 

20 

20 

20 

20 

20 

20 

Od 

Od 

Oa 

4c 

44 

55 

53 

32 

37 

20 

4b 

41 

43 

59 

20 

31 

31 

31 

33 

32 

33 

20 

00 

00 

00 

Od 

Od 

0a 

00 

05 

Oa 

c9 

d5 

ca 

31 

7c 

4c 

32 

36 

97 

81 

Oa 

ca 

d5 

ca 

31 

8a 

44 

96 

40 

15 

61 

Oa 

cb 

d5 

ca 

31 

2e 

7  f 

ce 

37 

8b 

33 

04 

cc 

d5 

ca 

31 

04 

cd 

d5 

ca 

31 

Od 

Od 

Oa 

03 

•  • 

08-11-97  13:37:49 

.  Events : 

2 

.  Responses 

0 

.  Message  Output  Cmds 

DISPLAY 

INPUT 

MESSAGE 

LOG 

INPUT  MESSAGE: 

15 

RECEIVE  TIME  (IPS) : 

08/11/97 

13: 

23: 

47 

CR02 

RECEIVE  TIME  (ADAS) : 

08/11/97 

13: 

23: 

47 

SIMULATOR  ID: 

11 

MESSAGE  TYPE: 

ITWS6 . LDD. MSG 

MESSAGE  SIZE: 

107 

GROUP  ID: 

15 

HEX  DUMP  OF  TEST  FILE: 

CR03 

01 

Od  Od  Oa  20  20  20  20 

20  20  20 

20 

20 

Od 

Od 

Oa  4c 

44 

55 

53 

32 

37  20  4b  41  43  59  20 

31  31  31 

33 

32 

33 

20 

00  00 

00 

Od 

Od 

Oa 

00  06  Oa  ba  d5  ca  31 

be  a 6  79 

17 

8d 

11 

04 

bb  d5 

ca 

31 

04 

cO 

d5  ca  31  16  cl  d5  ca 

31  e8  7b 

8c 

38 

8b 

42 

99  80 

cf 

3a 

9a 

66 

06  80  23  3b  8b  71  04 

c2  d5  ca 

31 

Oa 

c3 

d5 

ca  31 

2a 

40 

ff 

3e  95  52  Od  Od  Oa  03 

ITWS1  LDP  INCOMMING  MESSAGE  CR01 

INPUT  MESSAGE  #:  17 

RECEIVE  TIME  (IPS) :  08/11/97  13:23:57 

RECEIVE  TIME  (ADAS) :  08/11/97  13:23:57 

SIMULATOR  ID:  6 

MESSAGE  TYPE:  ITWS1  LDP  MSG 

MESSAGE  SIZE:  90 

GROUP  ID:  17 

MESSAGE  TYPE:  ITWS1  LDD 

HEADER:  0x01 

TYPE:  LD 

GEOGRAPHIC  DESIG:  US 

BULLETIN:  27 

SITE  ID:  KACY 

DAY/HOUR/MINUTE:  11/13/23 

Number  of  Messages  5 

LDD  FORMAT  IN  H EXDECIMAL 

LENGTH  INDICATOR  :0a 
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ITWS1 . LDD. MSG 
90 
17 


DATE/TIME  FIELD 
FLASH  RECORD  #01 

LENGTH  INDICATOR 
DATE/TIME  FIELD 
FLASH  RECORD  #01 

LENGTH  INDICATOR 
DATE/TIME  FIELD 
FLASH  RECORD  #01 

LENGTH  INDICATOR 
DATE/TIME  FIELD 


:  c9 

d5 

ca 

31 

:7c 

4c 

32 

36 

97 

81 

:  0a 

:  ca 

d5 

ca 

31 

:  8a 

44 

96 

40 

15 

61 

:0a 

:  cb 

d5 

ca 

31 

:  2e 

7f 

ce 

37 

8b 

33 

:04 

:  cc 

d5 

ca 

31 

LENGTH  INDICATOR  :04 
DATE/TIME  FIELD  : cd  d5  ca  31 
No  more  messages  in  this  ADU 


INPUT  MESSAGE  #:  15  CR01 


(IPS)  : 
(ADAS ) 


RECEIVE  TIME 
RECEIVE  TIME 
SIMULATOR  ID: 
MESSAGE  TYPE: 
MESSAGE  SIZE: 

GROUP  ID: 

MESSAGE  TYPE: 
HEADER: 

TYPE: 

GEOGRAPHIC  DESIG: 
BULLETIN: 

SITE  ID: 

DAY/HOUR/MINUTE: 
Number  of  Messages 


08/11/97  13:23:47 
08/11/97  13:23:47 
11- 

ITWS6  LDD  MSG 
107 


15 


ITWS6  LDD 

0x01 


LD 
US 
27 

KACY 
11/13/23 
6 

LDD  FORMAT  IN  HEXDECIMAL 


LENGTH  INDICATOR 
DATE/TIME  FIELD 
FLASH  RECORD  #01 


LENGTH  INDICATOR 
DATE/TIME  FIELD 


LENGTH  INDICATOR 
DATE/TIME  FIELD 


LENGTH  INDICATOR 
DATE/TIME  FIELD 
FLASH  RECORD  #01 
FLASH  RECORD  #02 
FLASH  RECORD  #03 


LENGTH  INDICATOR 
DATE/TIME  FIELD 


:  0a 

:ba 

d5 

ca 

31 

:bc 

a6 

79 

17  8d  11 

:  04 

:  bb 

d5 

ca 

31 

:  04 

:  cO 

d5 

ca 

31 

:16 

:  cl 

d5 

ca 

31 

:e8 

7b 

8c 

38 

8b 

42 

:  99 

80 

cf 

3a 

9a 

66 

:  06 

80 

23 

3b 

8b 

71 

:  04 

:  c2 

d5 

ca 

31 
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LENGTH  INDICATOR  :0a  I 

DATE/TIME  FIELD  :c3  d5  ca  31 
FLASH  RECORD  #01  :2a  40  ff  3e  95  52 

No  more  messages  in  this  ADU 


DATA  EXTRACTED  FROM  LPMA  FILE:  CR01 


♦MON/DISK*  BLK=00010  08/11/97  13:23  Page  :  9 
ASCI I / 8 /NONE/BOP 


B4 

D5 

CA 

31 

OC 

7E 

7D 

96 

B5 

D5 

CA 

31 

0D 

7E 

7D 

96 

B6 

D5 

CA 

31 

0E 

7E 

7D 

96 

B7 

D5 

CA 

31 

62 

43 

ID 

40 

85 

21 

D7 

7E 

7D 

96 

B8 

D5 

CA 

31 

00 

7E 

7D 

96 

B9 

D5 

CA 

31 

01 

7E 

7D 

96 

BA 

D5 

CA 

31 

BC 

A6 

79 

17 

8D 

11 

EA 

7E 

.  .  . 

.  .  . 

.  .  . 

.  .  . 

.  .  . 

.  .  . 

.  .  . 

ITWS6 

,  LDD 

7D 

96 

BB 

D5 

CA 

31 

03 

7E 

7D 

96 

CO 

D5 

CA 

31 

78 

7E 

7D 

96 

Cl 

D5 

CA 

31 

E8 

7B 

8C 

38 

8B 

42 

99 

80 

CF 

3A 

9A 

66 

06 

80 

23 

3B 

8B 

71 

E3 

7E 

7D 

96 

C2 

D5 

CA 

31 

7A 

7E 

7D 

96 

C3 

D5 

CA 

31 

2A 

40 

FF 

3E 

95 

52 

17 

7E 

7D 

96 

.... 

,  , 

i  ■  •  < 

i  •  ■  • 

,  ,  ,  , 

,  ,  , 

*MON/DISK*  BLK=00012  08/11/97  13:24  Page  :  10 
ASCI I / 8 /NONE/BOP 

C4  D5  CA  31  7C  7E  7D  96  C5  D5  CA  31  5D  A6  88  IB  90  32  B7  7E  7D  96  C6  D5  CA  31 
18  10  7D  18  38  89  81 


33  7E  7D  96  C7  D5  CA  31  7F  7E  7D  96  C8  D5  CA  31  E5  B2  50  17  B8  01  D9  7E  7D  96  | 
C9  D5  CA  31  7C  4C  32 


36  97  81  53  7E  7D  96  CA  D5  CA  31  8A  44  96  40  15  61  IE  7E  7D  96  CB  D5  CA  31  2E 
7F  CE  37  8B  33  63  7E 


7D  DO  86  56  59  61  62  63  B0  B1  B2  B3  B4  B5  B6  B7  B8  B9  BA  BD  C8  C9  CA  CB  CC  CD 
CE  CF  DO  D2  D3  D4  D5  ITWS1LDD 


C-39 


D6  D7  D8  D9  DA  DB  DC  EO  El  E2  E3  E4  E5  E6  E7  E8  E9  EA  EB  EC  ED  EE  EF  FI  F3  F4 
F9  FA  C7  7E  7D  DO  87 


01  02  06  09  OB  12  17  18  1A  1C  IE  22  26  27  2B  2C  2E  55  57  58  64  65  68  6D  72  76 
79  10  7E  81  83  88  89 


8A  8B  8E  8F  92  94  95  97  98  99  9E  A1  A5  A6  A7  A8  AA  AB  AC  BB  BC  BE  D1  FO  F2  FO 
7E7D  96  CC  D5  CA  31 


74  7E  7D  96  CD  D5  CA  31  75  7E  7D  96  CE  D5  CA  31  9E  A6  15  17  92  52  8C  7E  7D  96  I 
CF  D5  CA  31  77  7E  7D 


96  DO  D5  CA  31  68  7E  7D  96  D1  D5  CA  31  F5  43  C5  41  85  21  FF  7E  7D  96  D2  D5  CA 
31  6A  7E  7D  96  D3  D5 


DATA  EXTRACTED  FROM  ADAS  FILE; 
COMMUNICATIONS  DATAPOINTS  CR01 


08-11-97  13:24:42 

.  Events : 

0  .  Responses: 

0  . 

DATAPOINT  CMDS 

DISPLAY  NLDN  COMMUNICATIONS  LU  DATAPOINTS 

ALERT  ALARM 

DATAPOINT  NAME  ID  VALUE  CURR  PAST  CURR  PAST  LAST  RESET 


CONNECTION  STATUS: 
13:22:22 

NLDN  FAILURES  TOTAL: 
13:22:22 

ERROR  DETECTED: 
13:22:22 

ERROR  DETECTED  TOTAL: 
13:22:22 

ITWS1: 


01  CFG-ACTIVE 
02  0 

03  0 

04  0 


08-11-97 

08-11-97 

08-11-97 

08-11-97 
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08-11-97  13:25:16 

.  Events:  4  .  Responses: 

0  . 

DATAPOINT  CMDS 

DISPLAY 

ITWS  COMMUNICATION  LU 

DATAPOINTS 

ALERT 

ALARM 

DATAPOINT  NAME 

ID 

VALUE  CURR  PAST 

CURR  PAST 

LAST  RESET 

CONNECTION  STATUS: 

01 

CFG-ACTIVE 

08-11-97 

13:22:22 

AWOS  MESSAGES  SENT: 

02 

100 

08-11-97 

13:22:22 

AWOS  ADU  MSGS  SENT 

:  03 

2 

08-11-97 

13:22:22 

LDD  MESSAGES  SENT: 

04 

367 

08-11-97 

13i22:23 

LDD  ADU  SENT: 

05 

29 

08-11-97 

13:22:23 

ITWS 6: 

08-11-97  13:25:48 

.  Events:  5  .  Responses: 

0  . 

DATAPOINT  CMDS 

DISPLAY  ITWS  COMMUNICATION  LU  DATAPOINTS  | 

ALERT  ALARM 

DATAPOINT  NAME  ID  VALUE  CURR  PAST  CURR  PAST  LAST  RESET 


CONNECTION  STATUS:  01  CFG-ACTIVE  08-11-97  | 

13:22:23 

AWOS  MESSAGES  SENT:  02  100  08-11-97 

13:22:23 

AWOS  ADU  MSGS  SENT:  03  2  08-11-97 

13:22:23 

LDD  MESSAGES  SENT:  04  367  08-11-97 

13:22:23 

LDD  ADU  SENT:  05  29  08-11-97 

13:22:23 


ADAS  EVENT  LOG  FILE  CR01  | 

EVENT  PRIORITY:  non-critical  DATE/TIME  STAMP:  08-11-97  13:22:24  | 

EVENT  SEQ.  NUMBER:  73  EVENT  TYPE:  62  CSC  ID:  22.01 

Status  of  the  NLDN  connection  has  changed.  | 

comm  status:  enabled- active  | 

EVENT  PRIORITY:  non-critical  DATE/TIME  STAMP:  08-11-97  13:39:37 
EVENT  SEQ.  NUMBER:  337  EVENT  TYPE:  62  CSC  ID:  22.01 

Status  of  the  NLDN  connection  has  changed. 

comm  status:  enabled-failed 


C-41 


ADAS  EVENT  LOG  FILE 


CR01 


EVENT  PRIORITY:  non-critical  DATE/TIME  STAMP:  08-11-97  13:22:57 
EVENT  SEQ.  NUMBER:  83  EVENT  TYPE:  21  CSC  ID:  11.02 

An  erroneous  message  has  been  triggered  by  System  Logging. 

message  type:  ADAS  received  error  message 

error  type:  NLDN  error  message  error  code:  Invalid  message  type 
original  esc  id:  22.01  error  number:  10 
error  offset:  270 

EVENT  PRIORITY:  non-critical  DATE/TIME  STAMP:  08-11-97  13:23:59 
EVENT  SEQ.  NUMBER:  2  EVENT  TYPE:  21  CSC  ID:  11.02 

An  erroneous  message  has  been  triggered  by  System  Logging. 

message  type:  ADAS  received  error  message 

error  type:  NLDN  error  message  error  code:  Invalid  message  type 
original  esc  id:  22.01  error  number:  1 
error  offset:  0 

EVENT  PRIORITY:  non-critical  DATE/TIME  STAMP:  08-11-97  13:23:59 
EVENT  SEQ.  NUMBER:  3  EVENT  TYPE:  21  CSC  ID:  11.02 

An  erroneous  message  has  been  triggered  by  System  Logging. 

message  type:  ADAS  received  error  message 

error  type:  NLDN  error  message  error  code:  Invalid  message  type 
original  esc  id:  22.01  error  number:  2 
error  offset:  30 

EVENT  PRIORITY:  non-critical  DATE/TIME  STAMP:  08-11-97  13:24:59 
EVENT  SEQ.  NUMBER:  16  EVENT  TYPE:  21  CSC  ID:  11.02 

An  erroneous  message  has  been  triggered  by  System  Logging. 

message  type:  ADAS  received  error  message 

error  type:  NLDN  error  message  error  code:  Invalid  message  type 
original  esc  id:  22.01  error  number:  3 
error  offset:  60 

EVENT  PRIORITY:  non-critical  DATE/TIME  STAMP:  08-11-97  13:24:59 
EVENT  SEQ.  NUMBER:  17  EVENT  TYPE:  21  CSC  ID:  11.02 

An  erroneous  message  has  been  triggered  by  System  Logging. 

message  type:  ADAS  received  error  message 

error  type:  NLDN  error  message  error  code:  Invalid  message  type 
original  esc  id:  22.01  error  number:  4 
error  offset:  90 

ADAS  EVENT  LOG  FILE  CR01 

EVENT  PRIORITY:  non-critical  DATE/TIME  STAMP:  08-11-97  13:16:35 
EVENT  SEQ.  NUMBER:  44  EVENT  TYPE:  61  CSC  ID:  21.01 

Status  of  the  ITWS  connection  has  changed. 

site  id:  1001 

comm  status:  enabled-failed 

EVENT  PRIORITY:  non-critical  DATE/TIME  STAMP:  08-11-97  13:16:35 
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EVENT  SEQ.  NUMBER:  45  EVENT  TYPE:  61  CSC  ID:  21.01 

Status  of  the  ITWS  connection  has  changed. 

site  id:  1002 

comm  status:  enabled-f ailed 

EVENT  PRIORITY:  non-critical  DATE/TIME  STAMP:  08-11-97  13:16:35 
EVENT  SEQ.  NUMBER:  46  EVENT  TYPE:  61  CSC  ID:  21.01 

Status  of  the  ITWS  connection  has  changed. 

site  id:  1003 

comm  status:  enabled-f ailed 

EVENT  PRIORITY:  non-critical  DATE/TIME  STAMP:  08-11-97  13:16:35 
EVENT  SEQ.  NUMBER:  47  EVENT  TYPE:  61  CSC  ID:  21.01 

Status  of  the  ITWS  connection  has  changed. 

site  id:  1004 

comm  status:  enabled-failed 

EVENT  PRIORITY:  non-critical  DATE/TIME  STAMP:  08-11-97  13:16:36 
EVENT  SEQ.  NUMBER:  48  EVENT  TYPE:  61  CSC  ID:  21.01 

Status  of  the  ITWS  connection  has  changed. 

site  id:  1005 

comm  status:  enabled-failed 

EVENT  PRIORITY:  non-critical  DATE/TIME  STAMP:  08-11-97  13:16:39 
EVENT  SEQ.  NUMBER:  49  EVENT  TYPE:  61  CSC  ID:  21.01 

Status  of  the  ITWS  connection  has  changed. 

site  id:  1006 

comm  status:  enabled-failed 

EVENT  PRIORITY:  non-critical  DATE/TIME  STAMP:  08-11-97  13:21:18 
EVENT  SEQ.  NUMBER:  60  EVENT  TYPE:  61  CSC  ID:  21.01 

Status  of  the  ITWS  connection  has  changed. 

site  id:  1005 

comm  status:  enabled-active 

EVENT  PRIORITY:  non-critical  DATE/TIME  STAMP:  08-11-97  13:21:20 
EVENT  SEQ.  NUMBER:  61  EVENT  TYPE:  61  CSC  ID:  21.01 

Status  of  the  ITWS  connection  has  changed. 

site  id:  1001 

comm  status:  enabled-active 

EVENT  PRIORITY:  non-critical  DATE/TIME  STAMP:  08-11-97  13:21:21 
EVENT  SEQ.  NUMBER:  62  EVENT  TYPE:  61  CSC  ID:  21.01 

Status  of  the  ITWS  connection  has  changed. 

site  id:  1006 

comm  status:  enabled- active 

EVENT  PRIORITY:  non-critical  DATE/TIME  STAMP:  08-11-97  13:21:23 
EVENT  SEQ.  NUMBER:  63  EVENT  TYPE:  61  CSC  ID:  21.01 

Status  of  the  ITWS  connection  has  changed. 
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site  id:  1002 

coiran  status :  enabled-active 

EVENT  PRIORITY:  non-critical  DATE/TIME  STAMP:  08-11-97  13:21:26 
EVENT  SEQ.  NUMBER:  65  EVENT  TYPE:  61  CS£  ID:  21.01 

Status  of  the  ITWS  connection  has  changed. 

site  id:  1003 

comm  status:  enabled- active 

EVENT  PRIORITY:  non-critical  DATE/TIME  STAMP:  08-11-97  13:21:30 
EVENT  SEQ.  NUMBER:  66  EVENT  TYPE:  61  CSC  ID:  21.01 

Status  of  the  ITWS  connection  has  changed. 

site  id:  1004 

comm  status :  enabled- active 

EVENT  PRIORITY:  non-critical  DATE/TIME  STAMP:  08-11-97  13:34:27 
EVENT  SEQ.  NUMBER:  164  EVENT  TYPE:  61  CSC  ID:  21.01 

Status  of  the  ITWS  connection  has  changed. 

site  id:  1006 

comm  status:  enabled-failed 

EVENT  PRIORITY:  non-critical  DATE/TIME  STAMP:  08-11-97  13:34:33 
EVENT  SEQ.  NUMBER:  166  EVENT  TYPE:  61  CSC  ID:  21.01 

Status  of  the  ITWS  connection  has  changed. 

site  id:  1002 

comm  status:  enabled-failed 

EVENT  PRIORITY:  non-critical  DATE/TIME  STAMP:  08-11-97  13:34:37 
EVENT  SEQ.  NUMBER:  167  EVENT  TYPE:  61  CSC  ID:  21.01 

Status  of  the  ITWS  connection  has  changed. 

site  id:  1003 

comm  status:  enabled-failed 

EVENT  PRIORITY:  non-critical  DATE/TIME  STAMP:  08-11-97  13:34:46 
EVENT  SEQ.  NUMBER:  171  EVENT  TYPE:  61  CSC  ID:  21.01 

Status  of  the  ITWS  connection  has  changed. 

site  id:  1001 

comm  status:  enabled-failed 

EVENT  PRIORITY:  non-critical  DATE/TIME  STAMP:  08-11-97  13:34:50 
EVENT  SEQ.  NUMBER:  173  EVENT  TYPE:  61  CSC  ID:  21.01 

Status  of  the  ITWS  connection  has  changed. 

site  id:  1004 

comm  status:  enabled-failed 


C-44 


EVENT  PRIORITY:  non-critical  DATE/TIME  STAMP:  08-11-97  13:34:53 
EVENT  SEQ.  NUMBER:  174  EVENT  TYPE:  61  CSC  ID:  21.01 

Status  of  the  ITWS  connection  has  changed. 

site  id:  1005 

comm  status:  enabled-f ailed 
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C.1.4.2.  TCF  Test  Procedure  Steps 
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C.1.5.  TEST  AL-02A 


The  following  paragraphs  provide  information  about  data  associated  with  this 
test  but  not  included  within  the  main  body  of  this  report. 

C.1.5.1.  Associated  Evaluation  Criteria  and  Data 

The  following  Evaluation  Criteria  were  used  to  determine  the  requirements 
passed/ failed.  The  Cross  Reference  (CR)  numbers  can  be  used  to  trace  into  the 
data  found/referenced  below. 

Pass  Fail 

a.  [X]  [  ]  Each  test  procedure  step's  "pass”  box,  in  the  'Observed 

Results'  column,  is  marked,  indicating  the  'Expected 
Response'  was  observed,  and  the  test  data  was  capture  to  a 
DOS  ASCII  file  on  the  PSF-PC. 

b.  fX]  [  ]  ADAS  processed  lightning  data  acquired  from  outside  the  NAS. 

CR01  { LSS2-001 } 


c.  [X]  [  ]  ADAS  processed  data  from  NLDN.  CR02  { LSS2-003 } 

d.  [X]  [  ]  ADAS  stored  lightning  data.  CR03  {LSS2-004) 

e.  [X]  [  ]  ADAS  maintained  lightning  data  database . CR04  {LSS2-006) 

f.  [x]  [  ]  ADAS  calculated  proximity  of  lightning  strike  to  the  AWOS 

Service  location  within  the  ACF .  CR05  i IjS S 2  —  0 0 8 } 

g.  [X]  t  ]  ADAS  generated  a  message  indicating  that  lightning  was 

active,  when  the  lightning  had  occurred  within  the  defined 
geographical  areas  surrounding  the  AWOS  location. CR06  {LSS2- 
009} 

h.  [X]  [  ]  ADAS  maintained  the  status  of  lightning  activity  movement 

for  the  AWOS  service  location  for  a  period  of  15  minutes. 
CR07  { LSS2-010 } 

i.  [X]  [  ]  ADAS  maintained  the  status  of  lightning  activity  for  the 

AWOS  service  location  for  15  minutes  and  identified  the 
cessation  of  lightning  activity.  CR08  { LSS2-011 ) 

j.  [X]  [  ]  ADAS  maintained,  for  the  AWOS,  a  count  of  lightning  strikes 

for  the  last  fifteen  minutes.  CR09  {LSS2-016}  [NOTE:  ADAS 
maintains  these  counts  internally  and  therefore  it  can  only 
be  determined  through  code  inspections.  Code  inspections 
were  performed  at  DT&E  and  will  not  be  performed  during 
OT&E.  However,  ADAS  LAD  messages  do  maintain  a  15  minute 
persistence  for  lightning  activity  for  each  Zone/Sector. 
Therefore  a  "PASS"  indication  for  this  and  the  next  three 
criteria  will  indicate  that  this  capability  was  verified.] 

k.  [X]  [  ]  ADAS  maintained,  for  the  AWOS,  a  count  of  lightning  strikes 

for  the  last  fifteen  minutes,  for  those  strikes  that 
C-51 


occurred  at  radius  5nm  and  within  of  the  Airport  Reference 
Point  (ARP).  CR10  (LSS2-017)  [See  "NOTE"  for  requirement  I 
LSS2-016]  .  .  . 

[X]  [  ]  ADAS  maintained,  for  the  AWOS,  a  count  of  lightning  strikes 

for  the  last  fifteen  minutes,  for  those  strikes  that 

occurred  within  a  ring  of  radius  greater  than  5nm  and  less 
than  or  equal  to  lOnm  of  the  Airport  Reference  Point  (ARP). 
CRH  (LSS2-018)  [See  "NOTE"  for  requirement  LSS2-016] .  | 

[X]  [  ]  ADAS  maintained,  for  the  AWOS,  a  count  of  lightning  strikes 

for  the  last  fifteen  minutes,  for  each  of  the  eight  sectors 

within  a  ring  of  radius  between  lOnm  to  30nm  of  the  Airport 
Reference  Point  (ARP) .  The  eight  sectors  correspond  to  the 
eight  cardinal  points.  CR12  (LSS2-019)  [See  "NOTE"  for  | 
requirement  LSS2-016] . 


All  relevant  OT&E  formal  test  run  data  has  been  included  into  test  files: 
OT&E  #1:  al-02a-l . itl :  CR01,  CR02 

al-02a-l .lad:  CRQ1  -  CR12 
al-02a-l . nld:  CR01,  CR02 
OT&E  #2:  al-02a-l . cap :  Supports  OT&E  #1  CRs 
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To  log  into  AUC  enter:  The  ADAS  prompt  should  appear  on  the  AUC.  On  [x]  Pass  [  ]  Fail  Stop  Test 

login:  "adas"  the  AUC  one  of  the  following  messages  will 

password:  "adasl23"  appear: 

"The  ADAS  application  is  running... 


TEST  ID:  AL-02A  TEST  OPERATOR:  Don  Groot  DATE:  1/8/98  TIME:  13:25  TEST  DIRECTOR’S  INITIALS 
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21.  To  log  into  ASC  enter:  ADAS  SI  (ASI)  starts  [x]  Pass  [  ]  Fail  Stop  Test 

login:  "si" 
password:  "testl2" 
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TEST  ID:  AL-02A  TEST  OPERATOR:  Don  Groot  DATE:  1/8/98  TIME:  13:25  TEST  DIRECTOR’S  INITIALS 


C.1.6.  TEST  AL-02B 


The  following  paragraphs  provide  information  about  data  associated  with  this 
test  but  not  included  within  the  main  body  of  this  report. 


C.1.6.1.  Associated  Evaluation  Criteria  and  Data 

The  following  Evaluation  Criteria  were  used  to  determine  the  requirements 
passed/failed.  The  Cross  Reference  (CR)  numbers  can  be  used  to  trace  into  the 
data  found/referenced  below. 

Pass  Fail 

a.  [X]  [  ]  Each  test  procedure  step's  "pass"  box,  in  the  'Observed 

Results'  column,  is  marked,  indicating  the  'Expected 
Response'  was  observed  and/or  the  correct  action  was 
performed  successfully.  (See  Appendix  C  for  the  test 
procedures  performed  for  this  test). 

b.  [X]  [  ]  ADAS  processed  lightning  data  acquired  from  outside  the  NAS. 

CR01  { LSS2-001 )  i 

c.  [X]  [  ]  ADAS  processed  data  from  NLDN .  CR02  { LSS2-003 )  | 

d.  [X]  (  ]  ADAS  stored  lightning  data.  CR03  ( LSS2-004 )  ] 

e.  [X]  [  ]  ADAS  maintained  lightning  data  database . CR04  (LSS2-006)  j 

f.  [X]  [  ]  ADAS  calculated  proximity  of  lightning  strike  to  the  AWOS 

service  location  within  the  ACF.  CR05  ( LSS2-008 )  j 

g.  [X]  [  ]  ADAS  generated  a  message  indicating  that  lightning  was 

active,  when  the  lightning  had  occurred  within  the  defined 
geographical  areas  surrounding  the  AWOS  location . CR06  { LSS2—  j 
009)  1 

h.  [X]  t  ]  ADAS  maintained  the  status  of  lightning  activity  movement 

for  the  AWOS  service  location  for  a  period  of  15  minutes. 
CR07  { LSS2-010 )  I 

i.  [p]  [  ]  ADAS  maintained  the  status  of  lightning  activity  for  the 

AWOS  service  location  for  15  minutes  and  identified  the 
cessation  of  lightning  activity.  CR08  ( LSS2-011 )  PTR  OTE-  J 
054 

j.  [X]  [  ]  ADAS  maintained,  for  the  AWOS,  a  count  of  lightning  strikes 

for  the  last  fifteen  minutes.  CR09  {LSS2-016}  [NOTE:  ADAS  j 
maintains  these  counts  internally  and  therefore  it  can  only 
be  determined  through  code  inspections.  Code  inspections 
were  performed  at  DT&E  and  will  not  be  performed  during 
OT&E .  However,  ADAS  LAD  messages  do  maintain  a  15  minute 
persistence  for  lightning  activity  for  each  Zone/Sector. 


C-57 


Therefore  a  "PASS"  indication  for  this  and  the  next  three 
criteria  will  indicate  that  this  capability  was  verified.] 

]  ADAS  maintained,  for  the  AWOS,  a  count  of  lightning  strikes 

for  the  last  fifteen  minutes,  for  those  strikes  that 

occurred  at  radius  5nm  and  within  of  the  Airport  Reference 
Point  (ARP).  CR10  (LSS2-017)  [See  "NOTE"  for  requirement 
LSS2-016] . 

]  ADAS  maintained,  for  the  AWOS,  a  count  of  lightning  strikes 

for  the  last  fifteen  minutes,  for  those  strikes  that 

occurred  within  a  ring  of  radius  greater  than  5nm  and  less 
than  or  equal  to  lOnm  of  the  Airport  Reference  Point  (ARP) . 
CR11  ( LSS2-018 )  [See  "NOTE"  for  requirement  LSS2-016] . 

]  ADAS  maintained,  for  the  AWOS,  a  count  of  lightning  strikes 

for  the  last  fifteen  minutes,  for  each  of  the  eight  sectors 

within  a  ring  of  radius  between  lOnm  to  30nm  of  the  Airport 
Reference  Point  (ARP) .  The  eight  sectors  correspond  to  the 
eight  cardinal  points.  CR12  [LSS2-019)  [See  "NOTE"  for 
requirement  LSS2-016] . 

]  live  AWOS  correctly  reported  the  occurrence  of  lightning 

that  occurred  at  radius  5nm  and  within  of  the  ARP  as  0x40 
and  LTG  AT  ARPT.  CR13  [LSS3-006) 

]  live  AWOS  correctly  reported  the  occurrence  of  lightning 

that  occurred  within  a  ring  of  radius  greater  than  5nm  and 
less  than  or  equal  to  lOnm  of  the  ARP  as  0x80  and  LTG  VCNTY. 
CR14  ( LSS3-007 ) 

]  live  AWOS  correctly  reported  the  occurrence  of  lightning 

between  10  to  30nm  of  the  ARP  as  0x4  0  and  "LTG  DSNT  W" 
CR15  { LSS3-008 ) 

]  live  AWOS  correctly  reported  the  occurrence  of  lightning 

between  10  to  30nm  of  the  ARP  as  0x60  and  "LTG  DSNT  SW  AND 
W"  CR16  (L5S3-008) 

]  live  AWOS  correctly  reported  the  occurrence  of  lightning 

between  10  to  30nm  of  the  ARP  as  0x70  and  "LTG  DSNT  S  -  W" 
CR17  ( LSS3-008 } 

]  live  AWOS  correclty  reported  the  occurrence  of  lightning 

between  10  to  30nm  of  the  ARP  as  0x30  and  "LTG  DSNT  S  AND 
SW"  CR18  { LSS3-008 ) 

]  live  AWOS  correctly  reported  the  occurrence  of  lightning 

between  10  to  30nm  of  the  ARP  as  0x58  and  "LTG  DSNT  SE  -  W" 
CR19  ( LSS3-008 ) 

]  live  AWOS  correctly  reported  the  occurrence  of  lightning 

between  10  to  30nm  of  the  ARP  as  0x4a  and  "LTG  DSNT  NE  AND 
SE  AND  W"  CR20  {LSS3-008) 

]  live  AWOS  correctly  reported  the  occurrence  of  lightning 

between  10  to  30nm  of  the  ARP  as  Oxle  and  "LTG  DSNT  NE  -  S" 
CR21  { LSS3-008 } 


live  AWOS  correctly  reported  the  occurrence  of  lightning 
between  10  to  30nm  of  the  ARP  as  "LTG  DSNT  ALQDS' 
CR22  { LSS3-008 ) 

live  AWOS  correctly  reported  the  occurrence  of  lightning 
between  10  to  30nm  of  the  ARP  as  0x4  and  "LTG  DSNT  E 
CR23  { LSS3-008 ) 

live  ASOS  correctly  reported  the  occurrence  of  lightning 
that  occurred  at  radius  5nm  and  within  of  the  ARP  as  0x40 
and  LTG  AT  ARPT.  CR24  (LSS3-006) 

live  ASOS  correctly  reported  the  occurrence  of  lightning 

that  occurred  within  a  ring  of  radius  greater  than  5nm  and 
less  than  or  equal  to  lOnm  of  the  ARP  as  0x80  and  LTG  VCNTY. 
CR25  { LSS3-007 ) 

live  ASOS  correctly  reported  the  occurrence  of  lightning 

between  10  to  30nm  of  the  ARP  as  0x40  and  "LTG  DSNT  W 
CR26  { LSS3-008 ) 

live  ASOS  correctly  reported  the  occurrence  of  lightning 

between  10  to  30nm  of  the  ARP  as  0x60  and  "LTG  DSNT  SW  AND. 
W"  CR27  { LSS3-008 ) 

live  ASOS  correctly  reported  the  occurrence  of  lightning 

between  10  to  30nm  of  the  ARP  as  0x70  and  "LTG  DSNT  S  -  W' 
CR28  { LSS3-008 } 

live  ASOS  correclty  reported  the  occurrence  of  lightning 

between  10  to  30nm  of  the  ARP  as  0x30  and  "LTG  DSNT  S  AND 
SW"  CR29  { LSS3-008 } 

live  ASOS  correctly  reported  the  occurrence  of  lightning 

between  10  to  30nm  of  the  ARP  as  0x58  and  "LTG  DSNT  SE  -  W ' 
CR30  { LSS3-008) 

live  ASOS  correctly  reported  the  occurrence  of  lightning 

between  10  to  30nm  of  the  ARP  as  0x4a  and  "LTG  DSNT  NE  AND 
SE  AND  W"  CR3 1  {LSS3-008) 

live  ASOS  correctly  reported  the  occurrence  of  lightning 

between  10  to  30nm  of  the  ARP  as  Oxle  and  "LTG  DSNT  NE  -  S” 
CR32  { LSS3-008 } 

live  ASOS  correctly  reported  the  occurrence  of  lightning 

between  10  to  30nm  of  the  ARP  as  "LTG  DSNT  ALQDS" 
CR33  { LSS3-008 ) 

live  ASOS  correctly  reported  the  occurrence  of  lightning 

between  10  to  30nm  of  the  ARP  as  0x4  and  "LTG  DSNT  E" 
CR34  { LSS3-008 ) 

ADAS  disseminated  current  LAD  to  AWOS/ASOS  once  per  minute 
and  AWOS/ASOS  incorporated  LAD  into  OMO.  CR37  { LSS2-014 , 
LSS2-020,  LSS3-002 ,  LSS3-004,  LSS3-005) 


kk.  [X]  [  ]  The  AWOS  identified  the  thunderstorms  in  the  surface 

observation  by  reporting  remotely  sensed  lightning  detection 
data  (sent  to  the  AWOS  in  the  LAD  message) .  CR38  (LSS3-001) 

11 •  [X]  [  ]  The  ASOS  identified  the  thunderstorms  in  the  surface 

observation  by  reporting  remotely  sensed  lightning  detection 
data  (sent  to  the  ASOS  in  the  LAD  message) .  CR39  (LSS3-001) 


All  relevant  OT&E  formal  test  run  data  has  been  included  into  test  files: 
OT&E  #1:  al-02b-2 . cap:  CR01  -  CR12,  &  CR15 

al-02b-2 . aai :  CR24  -  CR35 
al-02b-2 . otis :  CR13  -  CR23  &  CR35 
OT&E  #2:  al-02b-2 . cap :  CR08  (OTE-054) 
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To  log  into  A0C  enter:  The  ADAS  prompt  should  appear  on  the  AUC.  On  [x]  Pass  [  ]  Fail  Stop  Test 

login:  "adas"  the  AUC  one  of  the  following  messages  will 

password:  "adasl23"  appear:  ..... 

"The  ADAS  application  is  running... 


TEST  ID:  AL-02B  TEST  OPERATOR:  Don  Groot  DATE:  1/8/98  TIME:  16:00  TEST  DIRECTOR’S  INITIALS 
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To  log  into  ASC  enter:  ADAS  SI  (ASI)  starts  [x]  Pass  [  ]  Fail  Stop  Test 

login:  "si" 
password:  "testl2" 


TEST  ID:  AL-02B  TEST  OPERATOR:  Don  Groot  DATE:  1/8/98  TIME:  16:00  TEST  DIRECTOR'S  INITIALS 
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C.1.7.  TEST  AL-02C 

The  following  paragraphs  provide  information  about  data  associated  with  this 
test  but  not  included  within  the  main  body  of  this  report. 


C.1.7.1.  Associated  Evaluation  Criteria  and  Data 

The  following  Evaluation  Criteria  were  used  to  determine  the  requirements 
passed/ failed.  The  Cross  Reference  (CR)  numbers  can  be  used  to  trace  into  the 
data  found/referenced  below. 


Pass 

a-  [X] 


b.  [X] 

c.  [X] 

d.  [X] 

e.  [X] 

f.  [X] 

g.  [X] 


h.  [X] 

i.  [P] 


j.  [X] 


Fail 

t  ]  Each  test  procedure  step's  "pass"  box,  in  the  'Observed 
Results'  column,  is  marked,  indicating  the  'Expected 
Response'  was  observed  and/or  the  correct  action  was 
performed  successfully. 

[  ]  ADAS  processed  lightning  data  acquired  from  outside  the  NAS. 

CR01  { LSS2-001 )  | 

[  ]  ADAS  processed  data  from  NLDN.  CR02  {LSS2-003)  | 

[  ]  ADAS  stored  lightning  data.  CR03  {LSS2-004 )  | 

[  ]  ADAS  maintained  lightning  data  database . CR04  {LSS2-006)  | 

[  ]  ADAS  calculated  proximity  of  lightning  strike  to  the  AWOS 

service  location  within  the  ACF.  CR05  {LSS2-008}  | 

t  ]  ADAS  generated  a  message  indicating  that  lightning  was 
active,  when  the  lightning  had  occurred  within  the  defined 
geographical  areas  surrounding  the  AWOS  location . CR06  { LSS2- 
009}  : 

[  ]  ADAS  maintained  the  status  of  lightning  activity  movement 

for  the  AWOS  service  location  for  a  period  of  15  minutes. 
CR07  { LSS2-010 }  | 

[  ]  ADAS  maintained  the  status  of  lightning  activity  for  the 

AWOS  service  location  for  15  minutes  and  identified  the 
cessation  of  lightning  activity.  CR08  {LSS2-011)  PTR  OTE-  I 
052  ' 

[  ]  ADAS  maintained,  for  the  AWOS,  a  count  of  lightning  strikes 

for  the  last  fifteen  minutes.  CR09  {LSS2-016}  [NOTE:  ADAS  | 
maintains  these  counts  internally  and  therefore  it  can  only 
be  determined  through  code  inspections.  Code  inspections 
were  performed  at  DT&E  and  will  not  be  performed  during 
OT&E.  However,  ADAS  LAD  messages  do  maintain  a  15  minute 
persistence  for  lightning  activity  for  each  Zone/Sector. 
Therefore  a  "PASS"  indication  for  this  and  the  next  three 
criteria  will  indicate  that  this  capability  was  verified.] 
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k.  [X]  [  ]  ADAS  maintained,  for  the  AWOS,  a  count  of  lightning  strikes 

for  the  last  fifteen  minutes,  for  those  strikes  that 

occurred  at  radius  5nm  and  within  of  the  Airport  Reference 
Point  (ARP) .  CR10  ( LSS2-017 )  [See  "NOTE"  for  requirement  J 
LSS2-016] . 

l.  [X]  [  ]  ADAS  maintained,  for  the  AWOS,  a  count  of  lightning  strikes 

for  the  last  fifteen  minutes,  for  those  strikes  that 

occurred  within  a  ring  of  radius  greater  than  5nm  and  less 
than  or  equal  to  lOnm  of  the  Airport  Reference  Point  (ARP). 
CR11  { LSS2-018 )  [See  "NOTE"  for  requirement  LSS2-016] .  j 

m.  [X]  [  ]  ADAS  maintained,  for  the  AWOS,  a  count  of  lightning  strikes 

for  the  last  fifteen  minutes,  for  each  of  the  eight  sectors 
within  a  ring  of  radius  between  lOnm  to  30nm  of  the  Airport 
Reference  Point  (ARP) .  The  eight  sectors  correspond  to  the 
eight  cardinal  points.  CR12  ( LSS2-019 )  [See  "NOTE"  for  ] 
requirement  LSS2-016] . 

n.  [X]  [  ]  live  AWOS  correctly  reported  the  occurrence  of  lightning 

that  occurred  at  radius  5nm  and  within  of  the  ARP  as  0x4  0 
and  LTG  AT  ARPT.  CR13  [LSS3-006)  J 

o.  [X]  [  ]  live  AWOS  correctly  reported  the  occurrence  of  lightning 

that  occurred  within  a  ring  of  radius  greater  than  5nm  and 
less  than  or  equal  to  lOnm  of  the  ARP  as  0x80  and  LTG  VCNTY, 
CR14  ( LSS3-007 )  | 

p.  [X]  [  ]  live  AWOS  reported  the  occurrence  of  lightning  between  10  to 

30nm  of  the  ARP  as  0x1  and  "LTG  DSNT  N"  CR15  {LSS3-008}  f 

q.  [X]  [  ]  live  AWOS  reported  the  occurrence  of  lightning  between  10  to 

30nm  of  the  ARP  as  0X2  and  "LTG  DSNT  NE"  CR16  {LSS3-008)  \ 

r.  [X]  [  ]  live  AWOS  reported  the  occurrence  of  lightning  between  10  to 

30nm  of  the  ARP  as  0x4  and  "LTG  DSNT  E"  CR17  {LSS3-008]  ] 

s.  [X]  [  ]  live  AWOS  reported  the  occurrence  of  lightning  between  10  to 

30nm  of  the  ARP  as  0x8  and  "LTG  DSNT  SE"  CR18  [LSS3-008)  j 

t.  [X]  [  ]  live  AWOS  reported  the  occurrence  of  lightning  between  10  to 

30nm  of  the  ARP  as  0x10  and  "LTG  DSNT  S"  CR19  {LSS3-00B}  j 

u.  [X]  [  ]  live  AWOS  reported  the  occurrence  of  lightning  between  10  to 

30nm  of  the  ARP  as  0x20  and  "LTG  DSNT  SW"  CR20  (LSS3-008)  j 

v.  [X]  [  ]  live  AWOS  reported  the  occurrence  of  lightning  between  10  to 

30nm  of  the  ARP  as  0x40  and  "LTG  DSNT  W"  CR21  {LSS3-00B}  j 

w.  [X]  [  ]  live  AWOS  reported  the  occurrence  of  lightning  between  10  to 

30nm  of  the  ARP  as  0x80  and  "LTG  DSNT  NW"  CR22  {LSS3-008}  | 

x.  [X]  [  ]  live  ASOS  correctly  reported  the  occurrence  of  lightning 

that  occurred  at  radius  5nm  and  within  of  the  ARP  as  0x40 
and  LTG  AT  ARPT.  CR23  (LS53-006) .  j 
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y-  [X]  f  ]  live  ASOS  correctly  reported  the  occurrence  of  lightning 

that  occurred  within  a  ring  of  radius  greater  than  5nm  and 
less  than  or  equal  to  lOnm  of  the  ARP  as  0x80  and  LTG  VCNTY. 
CR24  { LSS3-007 }  | 

z*  [X]  [  ]  live  ASOS  reported  the  occurrence  of  lightning  between  10  to 

30nm  of  the  ARP  as  0x1  and  "LTG  DSNT  N"  CR25  {LSS3-008)  | 

aa-  [X]  [  ]  live  ASOS  reported  the  occurrence  of  lightning  between  10  to 

30nm  of  the  ARP  as  0x2  and  "LTG  DSNT  NE"  CR26  {LSS3-008)  | 

kb.  [X]  [  ]  live  ASOS  reported  the  occurrence  of  lightning  between  10  to 

30nm  of  the  ARP  as  0x4  and  "LTG  DSNT  E"  CR27  {LSS3-008}  | 

cc-  [X]  [  3  live  ASOS  reported  the  occurrence  of  lightning  between  10  to 

30nm  of  the  ARP  as  0x8  and  "LTG  DSNT  SE"  CR28  (LSS3-008)  | 

dd.  [X]  [  ]  live  ASOS  reported  the  occurrence  of  lightning  between  10  to 

30nm  of  the  ARP  as  0x10  and  "LTG  DSNT  S"  CR29  {LSS3-008}  | 

ee.  [X]  [  ]  live  ASOS  reported  the  occurrence  of  lightning  between  10  to 

30nm  of  the  ARP  as  0x20  and  "LTG  DSNT  SW"  CR30  (LSS3-008)  | 

ff-  [X]  [  ]  live  ASOS  reported  the  occurrence  of  lightning  between  10  to 

30nm  of  the  ARP  as  0x40  and  "LTG  DSNT  W"  CR31  {LSS3-008}  | 

<?<?•  [X]  [  ]  live  ASOS  reported  the  occurrence  of  lightning  between  10  to 

30nm  of  the  ARP  as  0x80  and  "LTG  DSNT  NW"  CR32  (LSS3-008)  | 

hh.  [X]  t  3  ADAS  disseminated  current  LAD  to  AWOS/ASOS  once  per  minute 

and  AWOS/ASOS  incorporated  LAD  into  OMO.  CR33  {LSS2-014, 
LSS2-020,  LSS3-002,  LSS3-004,  LSS3-005) 

ii-  [P]  [  3  The  ASOS  identified  the  thunderstorms  in  the  surface 

observation  by  reporting  remotely  sensed  lightning  detection 
data  (sent  to  the  AWOS  in  the  LAD  message).  CR34  (LSS3-001)  | 

PTR  OTE-037 


jj.  [X]  [  ] 

CR35  ( LSS3-001 ) 


The  AWOS  identified  the  thunderstorms  in  the  surface 
observation  by  reporting  remotely  sensed  lightning  detection 
data  (sent  to  the  ASOS  in  the  LAD  message)  . 


All  relevant  OT&E  formal  test  run  data  has  been  included  into  test  files: 

OT&E  #1:  al-02c-3 . cap :  CR01  -  CR12  &  CR33 

al-02c-3 . aai :  CR23  -  CR33 
al-02c-3 . otis :  CR13  -  CR22 
al-02c-4 . cap:  OTE-028 

OT&E  #2:  al-02c-l . cap:  CR08  (OTE-052),  OTE-010  &  -032,  OTE-OOB 

al-06-l.cap:  OTE-031 
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To  log  into  AUC  enter:  The  ADAS  prompt  should  appear  on  the  AUC.  On  [x]  Pass  [  ]  Fail  Stop  Test 

login:  "adas"  the  AUC  one  of  the  following  messages  will 

password:  "adasl23"  appear: 

"The  ADAS  application  is  running... 


TEST  ID:  A1-02C  TEST  OPERATOR:  Don  Groot  DATE:  1/12/98  TIME:  15:15  TEST  DIRECTOR'S  INITIALS 
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21.  To  log  into  ASC  enter:  ADAS  SI  (ASI)  starts  [x]  Pass  [  ]  Fail  Stop  Test 

login:  "si" 
password:  "tastl2" 
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C.1.8.  TEST  AL-03 

The  following  paragraphs  provide  information  about  data  associated  with  this 
test  but  not  included  within  the  main  body  of  this  report. 


C.1.8.1.  Associated  Evaluation  Criteria  and  Data 

The  following  Evaluation  Criteria  were  used  to  determine  the  requirements 
passed/failed.  The  Cross  Reference  (CR)  numbers  can  be  used  to  trace  into  the 
data  found/ referenced  below. 


Pass  Fail 


a.  [X] 


b. 

[X] 

c. 

[X] 

d. 

[X] 

e. 

[X] 

f . 

[X] 

g- 

[X] 

h.  [X] 

i.  [X] 


[  ]  Each  test  procedure  step's  "pass"  box,  in  the  'Observed 

Results'  column,  was  marked,  indicating  the  'Expected 
Response'  was  observed  and/or  the  correct  action  was 
performed  successfully. 

[  ]  ADAS  processed  lightning  data  acquired  from  outside  the  NAS. 

CR01  ( LSS2-001 )  I 

[  ]  ADAS  processed  data  from  NLDN.  CR02  { LSS2-003 )  J 

[  ]  ADAS  stored  lightning  data.  CR03  { LSS2-004 )  j 

[  ]  ADAS  maintained  lightning  data  database . CR04  (LSS2-006)  j 

[  ]  ADAS  calculated  proximity  of  lightning  strike  to  the  AWOS 

service  location  within  the  ACF .  CR05  ( LSS2-008 )  j 

[  ]  ADAS  generated  a  message  indicating  that  lightning  was 

active,  when  the  lightning  had  occurred  within  the  defined 
geographical  areas  surrounding  the  AWOS  location . CR06  ( LSS2-  j 
009)  I 

[  ]  ADAS  maintained  the  status  of  lightning  activity  movement 

for  the  AWOS  service  location  for  a  period  of  15  minutes. 
CR07  { LSS2-010 )  ! 

[  ]  ADAS  maintained,  for  the  AWOS,  a  count  of  lightning  strikes 

for  the  last  fifteen  minutes.  CR08  ( LSS2-016)  [NOTE:  ADAS  | 
maintains  these  counts  internally  and  therefore  it  can  only 
be  determined  through  code  inspections.  Code  inspections 
were  performed  at  DT&E  and  will  not  be  performed  during 
OT&E.  However,  ADAS  LAD  messages  do  maintain  a  15  minute 
persistence  for  lightning  activity  for  each  Zone/Sector. 
Therefore  a  "PASS"  indication  for  this  and  the  next  three 
criteria  will  indicate  that  this  capability  was  verified.) 


[X]  [  )  ADAS  maintained,  for  the  AWOS,  a  count  of  lightning  strikes 

for  the  last  fifteen  minutes,  for  those  strikes  that 
occurred  at  radius  5nm  and  within  of  the  Airport  Reference 
Point  (ARP)  .  CR09  (LSS2-017)  [See  "NOTE"  for  requirement  | 
LSS2-016] . 
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k.  [X]  [  ]  ADAS  maintained,  for  the  AWOS,  a  count  of  lightning  strikes 

for  the  last  fifteen  minutes,  for  those  strikes  that 

occurred  within  a  ring  of  radius  greater  than  5nm  and  less 
than  or  equal  to  lOnm  of  the  Airport  Reference  Point  (ARP). 
CR10  { L552-018 )  [See  "NOTE"  for  requirement  LSS2-016] .  J 

l.  [X]  [  ]  ADAS  maintained,  for  the  AWOS,  a  count  of  lightning  strikes 

for  the  last  fifteen  minutes,  for  each  of  the  eight  sectors 

within  a  ring  of  radius  between  lOnm  to  30nm  of  the  Airport 
Reference  Point  (ARP) .  The  eight  sectors  correspond  to  the 
eight  cardinal  points.  CR11  { LSS2-019 )  | 


All  relevant  OT&E  formal  test  run  data  has  been  included  into  test  files: 

OT&E  #1:  al-03-2 . cap:  CR01  -  CR11 

al-03-2 .nld:  CR01  &  CR02 

OT&E  #2:  al-03-l.cap:  Support  OT&E  #1  CRs. 
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C.1.9.  TEST  AL-04 

The  following  paragraphs  provide  information  about  data  associated  with  this 
test  but  not  included  within  the  main  body  of  this  report. 


C.l. 9.1.  Associated  Evaluation  Criteria  and  Data 

The  following  Evaluation  Criteria  were  used  to  determine  the  requirements 
passed/ failed.  The  Cross  Reference  (CR)  numbers  can  be  used  to  trace  into  the 
data  found/ referenced  below. 

Pass  Fail 

[X]  [  ]  Each  test  procedure  step's  "pass"  box,  in  the  'Observed 

Results'  column,  is  marked,  indicating  the  'Expected 

Response'  was  observed  and/or  the  correct  action  was 
performed  successfully. 

[X]  [  ]  ADAS  processed  data  from  NLDN .  CR01  { LSS2-003 }  j 

[X]  [  ]  ADAS  calculated  proximity  of  lightning  strike  to  the  AWOS 

service  location  within  the  ACF .  CR02  { LSS2-008 )  j 

[X]  [  ]  ADAS  generated  a  message  indicating  that  lightning  was 

active,  when  the  lightning  had  occurred  within  the  defined 
geographical  areas  surrounding  the  AWOS  location . CR03  {LSS2-  j 
009}  1 

All  relevant  OT&E  formal  test  run  data  has  been  included  into  test  files: 

OT&E  #1:  al-04-1 . cap :  CR01  -  CR03 

OT&E  #2:  al-04-1. cap:  Support  OT&E  #1  CRs 
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To  log  into  AUC  enter:  The  ADAS  prompt  should  appear  on  the  AUC.  On  [x]  Pass  [  ]  Fail  Stop  Test 

login:  "adas"  the  ADC  one  of  the  following  messages  will 

password:  "adasl23"  appear: 

"The  ADAS  application  is  running... 
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21.  To  log  into  ASC  enter:  ADAS  SI  (ASI)  starts  [x]  Pass  [  ]  Fail  Stop  Test 

login:  ”si" 
password:  "testl2" 


TEST  ID:  AL-04  TEST  OPERATOR:  Don  Groot  DATE:  1/29/98  TIME:  20:50  TEST  DIRECTOR'S  INITIALS 
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C.1.10.  TEST  AL-05 

The  following  paragraphs  provide  information  about  data  associated  with  this 
test  but  not  included  within  the  main  body  of  this  report. 


C.1.10.1.  Associated  Evaluation  Criteria  and  Data 

The  following  Evaluation  Criteria  were  used  to  determine  the  requirements 
passed/failed.  The  Cross  Reference  (CR)  numbers  can  be  used  to  trace  into  the 
data  found/referenced  below. 


Pass  Fail 

a-  [X]  [  ]  Each  test  procedure  step's  "pass"  box,  in  the  'Observed 

Results'  column,  is  marked,  indicating  the  'Expected 
Response'  was  observed  and/or  the  correct  action  was 
performed  successfully. 

b.  [  ]  [X]  ADAS  calculated  proximity  of  lightning  strike  to  the  AWOS 

service  location  within  the  ACF.  CR01  {LSS2-008}  PTR  | 
OTE-038  . . .  . 

c.  [  ]  [X]  ADAS  generated  a  message  indicating  that  lightning  was 

active,  when  the  lightning  had  occurred  within  the  defined 
geographical  areas  surrounding  the  AWOS  location. CR02  { LSS2- 
009}  PTR  OTE-038 

d.  [X]  [  ]  ADAS  disseminated  current  LDD  to  each  ITWS  once  per  minute. 

CR03  { L5S2-014 )  | 

All  relevant  OT&E  formal  test  run  data  has  been  included  into  test  files: 

OT&E  #1:  al-05-1 . cap :  CR01  -  CR03 

OT&E  #2:  al-05-1. cap:  Support  OT&E  #1  CRs 


C-84 


TEST  ID:  AL-05  TEST  OPERATOR:  Don  Groot  DATE:  1/12/98  TIME:  20:12  TEST  DIRECTOR'S  INITIALS 
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21.  To  log  into  ASC  enter:  ADAS  SI  (ASI)  starts  [x]  Pass  [  ]  Fail  Stop  Test 

login:  "si" 
password:  "testl2" 


TEST  ID:  AL-05  TEST  OPERATOR:  Don  Groot  DATE:  1/12/98  TIME:  20:12  TEST  DIRECTOR'S  INITIALS 
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C.1.11.  TEST  AL-06 

The  following  paragraphs  provide  information  about  data  associated  with  this 
test  but  not  included  within  the  main  body  of  this  report. 


C.1.11.1.  Associated  Evaluation  Criteria  and  Data 

The  following  Evaluation  Criteria  were  used  to  determine  the  requirements 
passed/ failed.  The  Cross  Reference  (CR)  numbers  can  be  used  to  trace  into  the 
data  found/ referenced  below. 


Pass 


[X] 


[X] 


[X] 

[X] 

[P] 


[X] 


Fail 

[  ]  Each  test  procedure  step's  "pass"  box,  in  the  'Observed 

Results'  column,  is  marked,  indicating  the  'Expected 
Response'  was  observed  and/or  the  correct  action  was 
performed  successfully. 

t  ]  ADAS  properly  accepted  and  interpreted  data  from  the  NLDN 
data  source  at  its  specified  data  rate  of  1200  baud,  when 
this  data  continuously  arrived  at  the  maximum  rate  of  1100 
lightning  strikes  per  minute.  LSS2-015,  LSS2-022,  LSS2-024, 
LSS3-002 ,  LSS3-004,  LSS3-005  CR01  (NOTE:  The  baud  rate  was 
also  tested  in  the  AL-01  tests) 

[  ]  At  the  maximum  input  rate  specified  in  (a)  ,  ADAS  detected 

all  error  conditions  in  the  LDD  input  stream. 

CR02 

f  ]  At  the  maximum  input  rate,  ADAS  captured  and  formed  all 

valid  LDD  input  messages.  LSS2-_00_2_  CR03  { 

[  ]  At  the  maximum  input  rate,  ADAS  properly  maintained 

performance  data  points  reflecting  the  status/ condition  of 
the  NLDN  interface.  LSS2-002  CR04  Note  1:  Verification  of  J 
CR04  can  be  found  in  these  TCF  step  by  step  procedures. 

Note  2:  Because  the  NLDN  LU  DP  printout  is  still  incorrect 
this  criteria  is  only  partially  verified.  The  ASC  screen 
reported  these  correctly.  See  PTR  OTE-042 

[  ]  ADAS  accepted  1100  data  messages  per  minute  from  the  NLDN. 

LSS2-015  CR05  t 


[  ]  [  ]  The  ADAS  interfaced  functionally  and  physically  with  the 

NLDN  at  a  rate  of  216  bits,  667  times  per  second.  ADAS 
transmitted  LAD  messages  to  AWOS  at  a  rate  of  152  bits  per 
minute .  LSS2-021,  LSS2-024, LSS3-009,  LSS3-010  CR06  (Note: 
This  was  not  verified  since  the  protocol  analyzer  data  was 
not  saved.  This  verification,  however,  was  performed  during 
the  AL-01  tests . ) 


h.  [X]  [  ]  Properly  generate  LAD  messages  for  AWOS.  LSS3-005 CR07 

i.  [X]  [  ]  AWOS  received  LAD  messages  from  ADAS.  LSS3-002  CR08 

C-89 


j  •  [X]  [  ]  ADAS  disseminated  the  LAD  to  the  correct  AWOS  within  one 

minute.  LSS2-020,  LSS2-021  and  LSS3-004  CR09  | 

k*  [X]  [  ]  AWOS/ASOS  reported  lightning  when  current  LAD  messages 

indicate  that  lightning  is  presently  active.  LSS3-005  CR10  | 

!•  [X]  [  ]  ADAS  disseminated  lightning  data  to  WMSCR  via  METAR 

messages. . LSS2-014  CR11  (NOTE:  Since  one  of  the  IPS  | 

channels  was  out,  6  of  the  simulated  AWOS  did  not  report  a 
METAR)  . 

m-  tX]  [  ]  ADAS  did  not  include  in  the  ADU  and  not  transmit  to  ITWS, 

any  indication  of  any  Flash  Message (s)  when  lightning  was 
missing  during  a  given  second (s)  of  the  five  second 
interval.  LSS2-014  CR12  | 

All  relevant  OT&E  formal  test  run  data  has  been  included  into  test  files: 

OT&E  #1:  al-06-1 . cap:  CR01  &  CR03 

al-06-1 . itd:  CR01,  CR03,  CR05,  &  CR07 

TCF  procedure  steps  (see  next  section)  &  printouts:  CR04 
OT&E  #2:  al-06-1. cap:  CR11 

al-06-1. evl:  CR02 

al-06-1. ips:  CR08,  CR09,  CR10,  &  CR12 
al-06-1. otis:  CR08,  CR09,  &  CR10 
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TEST  ID:  AL-06  TEST  OPERATOR:  Don  Groot  DATE:  2/5/98  TIME:  16:40  TEST  DIRECTOR’S  INITIALS 
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To  log  into  ASC  enter:  ADAS  SI  (ASI)  starts  [x]  Pass  [  ]  Fail  Redo  step 

login:  "si" 
password:  ”testl2" 
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30.  @NLDN:  Clear  the  NLDN  flash  buffer  when  it  is  full.  The  flash  buffer  is  empty.  [x]  Pass  [  ]  Fail  Redo  step 
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37.  At  minute  75  [70]  (see  note  for  step  25):  @ASC,  select  Verify  and  record  connection  status.  This  [x]  Pass  [  ]  Fail  Stop  Test 
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C.1.12.  TEST  AL-07 

This  test  was  combined  with  Test  AL-06. 


C.1.13.  TEST  AL-08 


The  following  paragraphs  provide  information  about  data  associated  with  this 
test  but  not  included  within  the  main  body  of  this  report. 


C.1.13.1.  Associated  Evaluation  Criteria  and  Data 

The  following  Evaluation  Criteria  were  used  to  determine  the  requirements 
passed/failed.  The  Cross  Reference  (CR)  numbers  can  be  used  to  trace  into  the 
data  found/referenced  below. 


Pass  Fail 


[X]  [  ]  Each  test  procedure  step's  "pass"  box,  in  the  'Observed 

Results'  column,  is  marked,  indicating  the  'Expected 
Response'  was  observed  and/or  the  correct  action  was 
performed  successfully. 

[X]  [  ]  All  results  were  properly  generated  as  described  in  Analysis 

Method  1.,  above.  LSS2-007  and  LSS2-012  CR01 

W  [  ]  All  results  were  properly  generated  as  described  in  Analysis 

Method  2.,  above.  LSS2-007  and  LSS2-012  CR02 

[X]  t  ]  All  results  were  properly  generated  as  described  in  Analysis 

Method  3.,  above.  LSS2-007  and  LSS2-013  CR03 

[X]  [  ]  All  results  were  properly  generated  as  described  in  Analysis 

Method  4.,  above.  LS53-003  CR04 

[X]  [  ]  All  results  were  properly  generated  as  described  in  Analysis 

Method  5.,  above.  LSS3-003  CR05 


All  relevant  OT&E  formal  test  run  data  has  been  included  into  test  files: 


OT&E  #1: 


OT&E  #2: 


al-08-1 . cap : 
al-08-1 . itl : 
al-08-1. dip: 
al-06-1 . cap: 


CR03  &  PTR  OTE-031 
CR01  &  CR02 

CR01 ,  CR02 ,  CR04  &  CR05 
Supports -resolution  of  PTR  OTE-031 
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@IUC  enter  "setdate"  IUC  will  display  the  date  and  time  in  the  10  [x]  Pass  [  ]  Fail  Stop  Test 

digit  format  MMDDhhmmYY. 
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23.  Wait  17  minutes  to  allow  all  15  minute  persistence  to  Satellite’  link  reestablished.  [x]  Pass  [  ]  Fail  Stop  Test 

flush  out  and  then  reestablish  the  satellite  link  to  . 
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29.  @ASC,  continue  to  monitor  the  AWOS  and  AS0S  station  Verify  recorded  time  for  AW0S  and  AS0S,  [x]  Pass  [  ]  Fail  Stop  Test 

configuration  status.  Go  to  [Display  Datapoints]  and 
then  (AWOS  Station] .  Record  the  time  when  each 
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C.1.14.  TEST  AL-09 

The  following  paragraphs  provide  information  about  data  associated  with  this 
test  but  not  included  within  the  main  body  of  this  report. 


C.1.14.1.  Associated  Evaluation  Criteria  and  Data 

The  following  Evaluation  Criteria  were  used  to  determine  the  requirements 
passed/failed.  The  Cross  Reference  (CR)  numbers  can  be  used  to  trace  into  the 
data  found/ referenced  below. 

Pass  Fail 

Each  test  procedure  step's  "pass"  box,  in  the  ’Observed 
Results'  column,  is  marked,  indicating  the  'Expected 
Response'  was  observed  and/or  the  correct  action  was 
performed  successfully. 

ADAS  processed  .lightning  data  acquired  from  outside  the  NAS. 
CR01  { LSS2-001 } 


ADAS  supported  data  collection  from  NLDN .  CR02  {LS52-002) 
ADAS  processed  data  from  NLDN.  CR03  {LSS2-003} 


ADAS  stored  lightning  data.  CR04  {LSS2-004 ) 

ADAS  maintained  lightning  data  database . CR05  {LSS2-006} 


ADAS  collected  data  from  the  NLDN.  CR06  {LSS2-007)  j 

ADAS  calculated  proximity  of  lightning  strike  to  the  AWOS 
service  location  within  the  ACF.  CR07  (LSS2-008)  | 

ADAS  generated  a  message  indicating  that  lightning  was 
active,  when  the  lightning  had  occurred  within  the  defined 
geographical  areas  surrounding  the  AWOS  location . CR08  { LSS2- 
009}  .  “  — - - - 

3  •  [X]  [  ]  ADAS  maintained  the  status  of  lightning  activity  movement 

for  the  AWOS  service  location  for  a  period  of  15  minutes. 
CR09  { LSS2-010 )  j 

k-  [P]  [  ]  ADAS  maintained  the  status  of  lightning  activity  for  the 

AWOS  service  location  for  15  minutes  and  identified  the 
cessation  of  lightning  activity.  CR10  {LSS2-011}  PTR  OTE-  I 
055  '  7 - 

!•  W  [  ]  ADAS  disseminated  current  LAD  to  AWOS/ASOS  and  LDD  to  each 

ITWS  once  per  minute  (the  ITWS  part  was  not  verified  since 
run  6  used  CONUS  as  ARTCC  boundary).  CR11  (LSS2-014)  | 

[X]  [  ]  ADAS  maintained,  for  the  AWOS,  a  count  of  lightning  strikes 

for  the  last  fifteen  minutes.  CR12  (LSS2-016)  [NOTE:  ADAS  | 
C-104 


a.  [X]  [  ] 

b.  [X]  [  ] 

c.  [X]  [  ] 

d.  [X]  [  ] 

e.  [X]  [  ] 

f.  [X]  [  ] 

g-  tx]  [  ] 

h.  [X]  [  ] 

i-  [X]  [  ] 


maintains  these  counts  internally  and  therefore  it  can  only 
be  determined  through  code  inspections.  Code  inspections 
were  performed  at  DT&E  and  will  not  be  performed  during 
OT&E.  However,  ADAS  LAD  messages  do  maintain  a  15  minute 
persistence  for  lightning  activity  for  each  Zone/Sector. 
Therefore  a  "PASS"  indication  for  this  and  the  next  three 
criteria  will  indicate  that  this  capability  was  verified.] 

ADAS  maintained,  for  the  AWOS,  a  count  of  lightning  strikes 
for  the  last  fifteen  minutes,  for  those  strikes  that 
occurred  at  radius  5nm  and  within  of  the  Airport  Reference 
Point  (ARP) .  CR13  (LSS2-017)  [See  "NOTE"  for  requirement  | 
LSS2-016] . 

ADAS  maintained,  for  the  AWOS,  a  count  of  lightning  strikes 
for  the  last  fifteen  minutes,  for  those  strikes  that 
occurred  within  a  ring  of  radius  greater  than  5nm  and  less 
than  or  equal  to  lOnm  of  the  Airport  Reference  Point  (ARP) . 
CR14  { LSS2-018 )  [See  "NOTE"  for  requirement  LSS2-016] .  | 


ADAS  maintained,  for  the  AWOS,  a  count  of  lightning  strikes 
for  the  last  fifteen  minutes,  for  each  of  the  eight  sectors 
within  a  ring  of  radius  between  lOnm  to  30nm  of  the  Airport 
Reference  Point  (ARP) .  The  eight  sectors  correspond  to  the 
eight  cardinal  points.  CR15  (LSS2-019)  [See  "NOTE"  for  j 
requirement  LSS2-016] . 

ADAS  used  the  existing  data  communication  lines  to  the  AWOS 

and  ASOS  to  send  LAD  messages.  CR16  (LSS2-021)  This  was  j 

verified  by  the  use  of  the  modem  dial-up  lines  to  AWOS  and 

ASOS. 

The  AWOS  identified  the  thunderstorms  in  the  surface 

observation  by  reporting  remotely  sensed  lightning  detection 
data  (sent  to  the  AWOS  in  the  LAD  message) .  CR17  [LSS3-001]  j 

The  ASOS  identified  the  thunderstorms  in  the  surface 

observation  by  reporting  remotely  sensed  lightning  detection 
data  (sent  to  the  ASOS  in  the  LAD  message) .  CR18  {LSS3-001}  J 

The  AWOS  received  lightning  detection  data  (in  the  form  of  a 

LAD  message)  from  the  ADAS  once  per  minute.  CR19  .{LSS3-p_02  I 

&  LSS3-004 }  1 

The  ASOS  received  lightning  detection  data  (in  the  form  of  a 

LAD  message)  from  the  ADAS  once  per  minute.  CR20  {LSS3-002  j 

&  LSS3-004 )  I 

The  AWOS  reported  lightning/thunderstorm  activity  when 
current  lightning  detection  date  (in  the  form  of  LAD 
messages)  indicated  that  lightning  was  presently  active. 
CR2 1  ( LSS3-005 )  I 


The  ASOS  reported  lightning/thunderstorm  activity  when 
current  lightning  detection  date  (in  the  form  of  LAD 
messages)  indicated  that  lightning  was  presently  active. 

CR22  { LSS3-005 )  I 


All  relevant  OT&E  formal  test  run  data  has  been  included  into  test  files 

OT&E  #1:  al-09-6 . cap :  CR01  -  CR10  &  CR12  -  CR15 

al-09-6 . dip :  CR11,  CR17  -  CR22 

al-09-6. aai:  CR11 

OT&E  #2:  al-02c-l.cap:  CR08  (OTE-008,  OTE-031),  new  PTR  OTE-052 

al-06-l.cap:  CR11  (OTE-008,  OTE-031) 

al-09-2 . cap :  New  PTR  OTE-055  and  supports  OT&E  #1  CRs 
al-09-3 . cap :  New  PTR  OTE-057 
al-09-4.cap:  New  PTR  OTE-057 


C-106 


C. 1.14.2.  TCF  Test  Procedure  Steps 
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If  the  previous  step's  response  indicated  that  ADAS  "ADAS  system  is  DOWN"  Cx]  Pass  [  ]  Fail  Stop  Test 

was  running  then  ->  @ASC  enter  "stop_adas" 

@IUC  enter  "setdate"  IUC  will  display  the  date  and  time  in  the  10  [x]  Pass  [  ]  Fail  Stop  Test 

digit  format  MMDDhhmmYY. 

@IUC  enter  "aetdate  MMDDhhamYir  and  @AUC  enter  IOC  and  AUC  will  display  the  updated  date  and  tx]  Pass  t  1  Fail  stop  Test 
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format.  "[F7]  [F8]  [F7]  AL-09  [RETURN]  [RETURN] 
(toggle  to  'file'}  [RETURN]  [select  'ITWS1  ldd ' } 
[RETURN]  [RETURN]  [wait]  [F14]  [F14]  [F14]" 


C.1.15.  TEST  AL-10 

The  following  paragraphs  provide  information  about  data  associated  with  this 
test  but  not  included  within  the  main  body  of  this  report. 


C.1.15.1.  Associated  Evaluation  Criteria  and  Data 

The  following  Evaluation  Criteria  were  used  to  determine  the  requirements 
passed/ failed.  The  Cross  Reference  (CR)  numbers  can  be  used  to  trace  into  the 
data  found/referenced  below. 

Pass  Fail 

a*  [X]  [  ]  Each  test  procedure  step's  "pass"  box,  in  the  'Observed 

Results'  column,  is  marked,  indicating  the  'Expected 
Response'  was  observed  and/or  the  correct  action  was 
performed  successfully. 

b .  [X]  [  ]  ADAS  stored  lightning  data.  CR01  {LSS2-004} 


All  relevant  OT&E  formal  test  run  data  has  been  included  into  test  files: 
OT&E  #2:  al-10-2 . cap :  CR01 


C-112 


If  the  previous  step's  response  indicated  that  ADAS  "ADAS  system  is  DOWN"  [x]  Pass  [  ]  Fail  Stop  Test 

was  running  then  ->  @ASC  enter  "stop_adas" 

@IUC  enter  "setdate"  IUC  will  display  the  date  and  time  in  the  10  [x]  Pass  [  ]  Fail  Stop  Test 

digit  format  MMDDhhmmYY. 
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time  depicted  on  the  ISI  screen  clock  display,  and  the 
current  date  based  on  zulu  time. 
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C.1.16.  TEST  AL-11 

The  following  paragraphs  provide  information  about  data  associated  with  this 
test  but  not  included  within  the  main  body  of  this  report. 


C.1.16.1.  Associated  Evaluation  Criteria  and  Data 

The  following  Evaluation  Criteria  were  used  to  determine  the  requirements 
passed/failed.  The  Cross  Reference  (CR)  numbers  can  be  used  to  trace  into  the 
data  found/ referenced  below. 

Pass  Fail 

a.  [X]  [  ]  Each  test  procedure  step's  "pass"  box,  in  the  'Observed 

Results'  column,  is  marked,  indicating  the  'Expected 
Response'  was  observed  and/or  the  correct  action  was 
performed  successfully. 

b.  [X]  [  ]  ADAS  processed  .lightning  data  acquired  from  outside  the  NAS. 

CR01  { LSS2-001 } 


c.  [X]  [  ]  ADAS  processed  data  from  NLDN .  CR02  (LSS2-003) 


All  relevant  OT&E  formal  test  run  data  has  been  included  into  test  files: 
OT&E  #1:  al-11-1 . cap :  CR01- and  CR02 

OT&E  #2:  al-11-1. cap  and  flashes.doc:  Supports  OT&E  #1  CRs 


C-116 
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To  log  into  ASC  enter:  ADAS  SI  (ASI)  starts  [x]  Pass  [  ]  Fail  Stop  Test 

login:  "si" 
password:  "testl2" 
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C.2.  CATEGORY  DE  -  Degraded  Operation  Tests 
C.2.1.  TEST  DE-01  -  Recoverable  I/O  Init.  Error  (AWOS) 

The  following  paragraphs  provide  information  about  data  associated  with  this 
test  but  not  included  within  the  main  body  of  this  report. 


C.2.1. 1.  Associated  Evaluation  Criteria  and  Data 

The  following  Evaluation  Criteria  were  used  to  determine  the  requirements 
passed/failed.  The  Cross  Reference  (CR)  numbers  can  be  used  to  trace  into  the 
data  found/referenced  below. 


Pass  Fail 

a.  [XX]  [  ]  Each  procedure  step's  "pass"  box,  in  the  'Observed  Results' 

column,  was  marked,  indicating  the  'Expected  Response'  was 
observed.  (See  Appendix  C  for  the  test  procedure  performed 
for  test  DE-01 . ) 

b.  [XX]  [  ]  The  ADAS  Event  Log  must  show  that  ADAS  detected  the  off-line 

AWOS  station  CR1  and  continued  to  the  Operational  State  -  | 
Reduce  Node  as  indicated  by  the  SYS_MODE  datapoint  (LU  0x20 
DP  0x02)  CR3.  i 


c.  [XX]  [  ]  After  communications  was  re-established,  the  AWOS  station 

must  be  reported  as  'Link  Status:  up'  CR2.  { 

d.  [XX]  [  ]  The  transition  from  Reduce  to  Full  Mode  must  have  occurred 

as  indicated  by  the  third  request  of  the  SYS_MODE  datapoint  (LU 

0x20  DP  0x02)  CR4 .  1 


The  following  data,  marked  with  evaluation  criteria  cross  reference  numbers, 
is  a  subset  of  the  OT&E  formal  test  run  data.  Other  relavent  data  has  been 
included  into  test  DE-01' s  Test  Conduct  Form  (TCF)  file,  "DE-01. TCF". 

EVENT  PRIORITY :  non- critical  .  DATE/TIME  STAMP: __  ,08-19-97  18 J.46.:..12 

f^NT'  SEQ:-NUMBERV"54  EVENT  TYPE:  5 . CSC  ID:  3.02 

Status  of  the  AWOS  connection  has  changed. 


AWOS  station  id:  K001 controller:  1 
channel :  1 

j^Pst^tusj  link  down  Event:  link  down _ _ _ 

EVENT  PRIORITY:  non- critical DATE/TIME  STAMP:  08-19-97  18:49:17 
EVENT  SEQ. '"NUMBER :""269""  EVENT  TYPE:  5  CSC  ID:  3.02 

Status  of  the  AWOS  connection  has  changed. 
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AWOS  station  id:  K001  controller:  1 


channel:  1 

Link  Status:  up  Event:  link  reset 


INPUT  MESSAGE  #:  1 

pCEI  VE"~T IMS '"'(ADAS  . 0  8  / 19/9718:48:09 

. 

13  RMS  ID:  _ _ _ 0x01  LOGICAL  UNIT  ID:  0x20 

. PATE: . 08/19/97  TIME:  1  - 

. DATAPOINT  ID :  0x02 . '  CONDITION ‘‘STATUS: . 6x42*’ 

PARAMETER  VALUE: . (66T)*"* Decimal’ . 

INPUT  MESSAGE  #:  21 

RECEIVE  TIM^TjjDAST'r  08 / 19/97  18:48:11 
■+++++++++++++++++++++++++ 


2883  RMS  ID:  0x01  LOGICAL  UNIT  ID: 


2885 . DATE: . .  ■  08/19/97  TIME 

2887 _  DATAPOINT  ID:  6x01  . CONDITION  STATUS 


2889  PARAMETER  VALUE: _ (001)  Decimal . . . . . . 


CONDITION  STATUS 


18:48:08 


0x41 


18:48:08 


0x42 


INPUT  MESSAGE  #:  158 

l|cIf^;’TlW’’TA5Ssn . 6 8/19/97  18:49:16 


21378  RMS  ID 


21380  DATE 


21382 DATAPOINT  ID: 


21384  PARAMETER  VALUE 


0x01 


08/19/97 


0x02 


(001)  Decimal 


INPUT  MESSAGE  #:  159 

RECEIVE  TiME’’’’( ADASTV . 6 8/19/97  18:51:01 


BaaiBiBaa 


21398  RMS  ID 


21400  DATE 


21402 DATAPOINT  ID: 


21404  PARAMETER  VALUE 


0x01 

08/19/97 


0x02 


(000)  Decimal 


LOGICAL  UNIT  ID: 


TIME 


CONDITION  STATUS 


LOGICAL  UNIT  ID: 

"time- 


condition  STATUS 


0x20 


18:49:16 


0x42 


0x20 


18:51:00 


0x40 


c 

o 

4-> 

P 

P 

p 

p 

p 

P 

P 

p 

•H 

tO 

<0 

CO 

co 

(0 

to 

CO 

to 

to 

4-J 

<D 

CD 

a; 

05 

<D 

<D 

0) 

<D 

a> 

o 

Eh 

Eh 

Eh 

Eh 

Eh 

Eh 

Eh 

H 

Eh 

<c 

a 

a 

a 

& 

a 

a 

a 

a 

a 

rH 

O 

o 

o 

O 

O 

o 

O 

o 

o 

•rl 

4-1 

P 

p 

P 

P 

p 

P 

p 

p 

«0 

Du 

V ) 

CO 

co 

CO 

co 

CO 

CO 

CO 

CO 

p 

p 

p 

CO 

CO 

CO 

a> 

& 

05 

Eh 

Eh 

Eh 

a 

a 

cd 

o 

o 

O 

p 

p 

P 

co 

CO 

CO 

iH 

H 

rH 

i— i 

iH 

rH 

rH 

•H 

•H 

*H 

•H 

•rH 

tI 

-H 

•H 

id 

rO 

m 

<d 

id 

id 

rd 

td 

Du 

Du 

Du 

Du 

Du 

Du 

1*4 

tw 

r-, 

m 

»— * 

r-, 

m 

— 

— 

“ 

“ 

*“* 

•“* 

i_i 

CO 

to 

CO 

to 

CO 

to 

10 

CO 

10 

to 

to 

to 

to 

CO 

to 

to 

(0 

05 

id 

to 

id 

id 

id 

id 

04 

a. 

CD 

CD 

&4 

cu 

o 4 

CD 

f—t 

•— i 

r-, 

x 

X 

X 

X 

X 

X 

X 

X 
> _ 1 

M 

CO 

p 

11) 

s 

PC 

M 

a 

H 

Q 

o 

o 

G 

Eh 

PC 

a 

05 

■H 

O' 

CD 

w 

CO 

rH 

o 

the 

•H 

p 

rH 

G 

T5 

0) 

T5 

05 

CO 

td 

id 

o 

o 

o 

r- 

CO 

■  *c 

rH 

rH 

p 

p  . 

p 

\ 

u 

to 

p 

05 

to 

tH 

o 

D 

a) 

e  • 

X! 

P 

•H 

iH 

in 

rH 

rH 

rH 

•H 

•H 

•rl 

td 

id 

id 

Cw 

tu 

Du 

r-i 

r-» 

“ 

*“*  . 

CO 

to 

to 

CO 

to 

CO 

id 

id 

id 

CD 

04 

04 

1—1 

r-i 

X 

X 

X 

w 

to 

a 

• 

•H 

o 

c 

p 

0) 

0) 

M 

o  • 

CO  2 

a) 

rH 

G 

0) 

CO 

p  p 

•H 

■  0) 

Dt  0) 

to  O 

p 

Cl 

O  M 

-  a 

u 

CD  O 

p 

<d 

to 

O 

to  to 

A  OT 

■H  *H 

o 

04 

rH 

p 

s  to 

id  co 

to 

CO  - 

•H  < 

p 

- 

p 

U  Q 

3 

p 

a)  M 

a;  pC 

a 

CO 

S  o 

CD 

p 

-H 

P  a 

CO  05 

0 

rH 

XI 

o 

id 

O 

r— t  n 

P  H 

<D 

P 

,, 

CO 

P 

M  rH 

id 

rH 

U  CO 

to 

, — . 

CO 

CO  G  CD 

U  !2 

A 

id  >i 

>t 

M 

DQ 

to 

•H  P  CO 

IH 

id 

p  id 

id 

CO 

U 

P 

CD-H 

D 

u 

CO  rH 

rH 

IH 

u 

M 

P  Id  X5 

X!  pC 

. 

a 

a 

D 

id 

G  U 

U  2 

Xh  p 

g  CO 

to 

CO 

p 

0)  O 

p 

O  M 

•H 

H 

to 

>  U  to 

id  to 

CD  - 

P  o 

Id  CD 

O  D 

0 

o 

CO 

o 

co 

0)  04  < 

W 

a 

o  o 

u 

CO 

D 

pC 

05  0)  0) 

04 

u 

M  D 

D 

04 

H 

Q 

x:  x:  x: 

<  H 

PC  Or 

04  H 

pC 

H 

<2J 

< 

Eh  Eh  Eh 

.  A  £■ 
d)  —  .. 
■j  c  n 
•H  B  w 
P  OS  V 


e 

U 

p 

M 

. 

o 

M 

O 

c 

a> 

•H 

•H 

>i  CD 

<15 

05 

p 

CO 

P 

P  < 

P 

U 

c 

•H 

U 

•H  ^ 

•H  04 

G 

a; 

- 

G 

H 

M  W 

P 

P 

M 

d5  rn 

<u  co 

a 

& 

M 

P 

>  S 

> 

id 

& 

p 

Q5 

CO 

PD 

CO 

u 

O 

& 

P 

M 

O  A 

(0  r-i 

■C  G  iH 
0)  h 
£  — 

-  V 

I  O  V 
u  „  = 

Od  lO 


4J11UU 
•H  CD  CO  CO 
<0  S  M  < 
S  4J  ©  © 


G  H  7*  - 

rl  rl  ft  " 


CO  Du 

Q>  •— •  = 

P  ..  r-. 

<0  oj  as 

C  V  g 

*d  £ 

6  P 

0  Du  n 

**“■8 

tiXT  *i 

<u  -h  a 

^  gs 

o  —  n 
£  £  s 
p 


w  ^  ft, 

isl 

a  “ 

M  £  g 
o)  ^  § 
X5  -  E. 


C-123 


C.2.2.  TEST  DE-02  -  Recoverable  I/O  Init.  Error  (MPS) 

The  following  paragraphs  provide  information  about  data  associated  with  this 
test  but  not  included  within  the  main  body  of  this  report. 


C.2.2.1.  Associated  Evaluation  Criteria  and  Data 

The  following  Evaluation  Criteria  were  used  to  determine  the  requirements 
passed/ failed.  The  Cross  Reference  (CR)  numbers  can  be  used  to  trace  into  the 
data  found/referenced  below. 

Pass  Fail 

a.  [XX]  [  ]  Each  procedure  step's  "pass"  box,  in  the  'Observed  Results' 

column,  was  marked,  indicating  the  'Expected  Response'  was 
observed.  (See  Appendix  C  for  the  test  procedure  performed 
for  test  DE-02 . ) 

b.  [XX]  [  ]  The  ADAS  Event  Log  must  show  that  ADAS  detected  the  off-line 

MPS  simulator  CR1  and  continued  to  the  Operational  State  -  | 
Reduce  Mode  as  indicated  by  the  SYS_MODE  datapoint  in  the 
ASC  Display  RMS  Master/Overall  Datapoint  screen  CR2 .  | 

c.  [XX]  [  ]  The  MPS  simulator  was  reported  as  active  when  communication 

was  enabled  CR3  .  I 

d.  [XX]  [  ]  The  transition  from  Reduce  to  Full  Mode  must  have  occurred 

as  indicated  by  the  SYS_MODE  datapoint  (LU  20  DP  02)  CR4.  | 


The  following  data,  marked  with  evaluation  criteria  cross-reference  numbers, 
is  a  subset  of  the  OT&E  formal  test  run  data.  Other  relavent  data  has  been 
included  into  DE-02 's  Test  Conduct  Form  (TCF)  file,  "DE-02. TCF'. 


08-19-97  19:03:59  .  Events:  0  .  Responses:  0  .  DATAPOINT  CMDS 


DISPLAY  RMS  MASTER/ OVERALL  LU  DATAPOINTS 

ALERT  ALARM 

DATAPOINT  NAME  ID  VALUE  CURR  PAST  CURR  PAST  LAST  RESET 

SYSTEM  STATE:  01  OPERATIONAL 

19:02:15 

OPERATIONAL  MODE:  02  REDUCED  CR2 

19:02:15 

INITIALIZATION  MODE:  03  COLD 

19:02:15 


08-19-97 

*  08-19-97  | 

08-19-97 


C-125 


RMS/MAINT  RESET:  04  None 

19:02:15 

SPECIALIST  LOGON:  05  REMOTE/LOG  OFF 

19:02:15 


08-19-97 

08-19-97 


ALERT  THRESHOLDS 
UPPER  LOWER  ENAB 

-1  -1  YES 

PRESS  UP/DOWN  ARROW  KEYS  TO  POSITION 


SCROLL 

SCROLL 

UP 

DOWN 

.  F7  ... 

•  •  •  F8  •  •  •  • 

.  .  F9  .  .  . 

.  ..  F10 

ALARM  THRESHOLDS 
UPPER  LOWER  ENAB 

-1  -1  YES 

TO  DISPLAY  THRESHOLDS. 

PREVIOUS 

EXIT 

SCREEN 

Fll  .....  F12  .  F13  _ _  F14 


EVENT  PRIORITY:  non-critical  DATE/TIME  STAMP:  08-19-97  19:01:22 

EVENT  SEQ.  NUMBER:  43  EVENT  TYPE:  7 _ CSC  ID:  6.01 

Status  of  the  MPS  connection  has  changed . 


comm  status: 


enabled- failed 


CR1 


EVENT  PRIORITY:  non-critical  DATE/TIME  STAMP:  08-19-97  19:04:29 
EVENT  SEQ.  NUMBER:  258  EVENT  TYPE:  7  CSC  ID:  6.01 

^as  changed. 


comm  status:  enabled-active 


|CR3 


INPUT  MESSAGE  #:  3 

RECEIVE  TIME  (ADAS):  08/19/97  19:05:09 


823  RMS  ID:  0x01  LOGICAL  UNIT  ID: 

825 _ DATE: . . . 08/19/97  TIME:' . 

827 DAT  AP  6 1  NT  ID:  6x01  . CONDI' TI ON "’STATUS: 

829  PARAMETER  VALUE:  (002)  Decimal 


0x23 

19:05:07 

. 6x4"6 . 


ICR3 


INPUT  MESSAGE  #:  158 

RECEIVE  TIME  (ADAS):  08/19/97  19:05:25 


21378  RMS  ID:  0x01 

2138 0  DAT E :  08/19/97 

'21382 . DATAPOINT  ID : . '6x02 . 

21384  PARAMETER  VALUE:  (000)  Decimal 


LOGICAL  UNIT  ID: 

TIME: . 

CONDITION  STATUS:' 


0x20 

19:65:2  0 

. 6x40' . 


CR4 
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13.  When  prompted  at  the  ISC  with  an  IPS  event.  The  Specialist  Interface  Default  screen  [X]  Pass  [  ]  Fail  Stop  Test 

Login  to  ADAS,  request  an  event  log  report  for  will  be  displayed, 
event  type  7,  logout,  then  acknowledge  then 


C.2.3.  TEST  DE-03  -  Recoverable  I/O  Init.  Error  (DLP) 

The  following  paragraphs  provide  information  about  data  associated  with  this 
test  but  not  included  within  the  main  body  of  this  report. 


C.2.3.1.  Associated  Evaluation  Criteria  and  Data 

The  following  Evaluation  Criteria  were  used  to  determine  the  requirements 
passed/failed.  The  Cross  Reference  (CR)  numbers  can  be  used  to  trace  into  the 
data  found/ referenced  below. 


a. 


b. 


c. 


d. 


Pass  Fail 


[XX]  [  ]  Each  procedure  step's  "pass"  box,  in  the  'Observed  Results' 

column,  was  marked,  indicating  the  'Expected  Response'  was 
observed.  (See  Appendix  C  for  the  test  procedure  performed 
for  test  DE-03 . ) 


[XX]  [  ]  The  ADAS  Event  Log  must  show  that  ADAS  detected  the  off-line 

DLP  simulator  CR1  and  continued  to  the  Operational  State  -  [ 
Reduce  Mode  as  indicated  by  the  SYS_MODE  datapoint  (LU  20  DP 
02)  in  the  Datapoint  request  CR2 .  ! 

[XX]  [  ]  After  communication  was  enabled,  the  DLP  simulator  must  be 

reported  as  active  CR3.  I 

[XX]  [  ]  The  transition  from  Reduce  to  Full  Mode  must  have  occurred 

as  indicated  by  the  third  request  of  the  SYS_MODE  datapoint 
CR4 .  I 


The  following  data,  marked  with  evaluation  criteria  cross-reference  numbers, 
is  a  subset  of  the  OT&E  formal  test  run  data.  Other  relavent  data  has  been 
included  into  DE-03' s  Test  Conduct  Form  (TCF)  file,  "DE-03. TCF" . 

EVENT  PRIORITY:  non-critical  DATE/TIME  STAMP:  08-19-97  19:16:56 

EVENT  SEQ.  NUMBER:  43  EVENT  TYPE:  1 . CSC  ID: . 4.05 

Status  of  the  DLP  connection  has  changed. 

comm  status:  enabled-failed  _ _ _ _ _ _ 


EVENT  PRIORITY:  non-critical  DATE/TIME  STAMP:  08-19-97  19:19:21 

EVENT  SEQ.  NUMBER:  258  EVENT  TYPE:  1 _ CSC  ID:  4.05 

Status  of  the  DLP  connection  has  changed. 


comm  status:  enabled-active 


CR3 


INPUT  MESSAGE  #:  1 

RECEIVE  TIME  (ADAS):  08/19/97  19:18:09 


13 


RMS  ID: 


0x01 


LOGICAL  UNIT  ID: 


0x20 


C-129 


.15 . DATE: . 08/19/97  TIME:  19:18:08 

22 . DATAPOINT  ID:  0x02 . . . CONDITION  STATUS: . 0x42 . 

24  PARAMETER  VALUE:  . "(Ml ) '"Decimal . . . 


INPUT  MESSAGE  #:  9 

RECEIVE  TIME  (ADAS):  08/19/97  19:18:10 


1203 

RMS  ID: 

++++++++++++++++ 

0x01 

LOGICAL  UNIT  ID: 

0x29  i 

1205 

DATE: 

08/19/97 

TIME: 

CD 

O 

OD 

CD 

tH 

1207 

DATAPOINT  ID: 

0x01 

CONDITION  STATUS: 

6x42 

1209 

PARAMETER  VALUE: 

(001)  Decimal 

CR1 

INPUT  MESSAGE  #: 

RECEIVE  TIME  (ADAS) : 

159 

08/19/97  19:20:16 

21398 

RMS  ID: 

0x01 

LOGICAL  UNIT  ID: 

0x20 

21400 

DATE: 

08/19/97 

TIME: 

19:20:16 

21402 

DATAPOINT  ID: 

6x02 

CONDITION  STATUS: 

6x4  0 

21404 

PARAMETER  VALUE 

:  (000)  Decimal 

CR4 
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@ISC:  '  "[F7]  [F8]  [F7]  DE-03  <2:[RTN]>  [SP] 

[RTN]  S  [UP]  <2: [RTN]>  (wait)  <3:[F14]>"  The  ISI  default  screen  is  displayed. 

@ Patch  Panel:  verify  that  a  patch  cable  A  cable  patches  the  SMP  port's  top  [X]  Pass  [  ]  Fail  Connect  Patch 
re-directs  the  IPS  SMP  output  to  the  PSF-PC  for  socket  to  the  PSF-PC  port's  top  socket.  Cable 

data  capture. 


C.2.4.  TEST  DE-04  -  Recoverable  I/O  Init.  Error  (WARP) 

The  following  paragraphs  provide  information  about  data  associated  with  this 
test  but  not  included  within  the  main  body  of  this  report. 


C.2.4.1.  Associated  Evaluation  Criteria  and  Data 

The  following  Evaluation  Criteria  were  used  to  determine  the  requirements 
passed/failed.  The  Cross  Reference  (CR)  numbers  can  be  used  to  trace  into  the 
data  found/ referenced  below. 


a . 


b. 


c. 


d. 


Pass  Fail 


[XX]  [ 


[XX]  [ 


[XX]  [ 

[XX]  [ 


Each  procedure  step's  "pass"  box,  in  the  'Observed  Results' 
column,  was  marked,  indicating  the  'Expected  Response'  was 
observed.  (See  Appendix  C  for  the  test  procedure  performed 
for  test  DE-04 . ) 

The  ADAS  Event  Log  must  show  that  ADAS  detected  the  off-line 
WARP  simulator  CR1  and  continued  to  the  Operational  State  -  | 
Reduce  Mode  as  indicated  by  the  SYS_MODE  datapoint  (LU  20  DP 
02)  in  the  Datapoint  request  CR2 .  j 

After  communication  was  enabled,  the  WARP  simulator  must  be 
reported  as  active  CR3  ■  I 

The  transition  from  Reduce  to  Full  Mode  must  have  occurred 
as  indicated  by  the  third  request  of  the  SYS_MODE  datapoint 
(LU  20  DP  02)  CR4 .  | 


The  following  data,  marked  with  evaluation  criteria  cross-reference  numbers, 
is  a  subset  of  the  OT&E  formal  test  run  data.  Other  relavent  data  has  been 
included  into  DE-04 's  Test  Conduct  Form  (TCF)  file,  "DE-04. TCF". 

EVENT  PRIORITY:  non-critical  DATE/TIME  STAMP:  08-19-97  19:27:42 
EVENT  SEQ.  NUMBER:  42  EVENT  TYPE:  2 CSC  ID:  4.01 
Status  of  the  WARP  connection  has  changed. 


comm  status : 


enabled- failed 


CR1 


EVENT  PRIORITY:  non-critical  DATE/TIME  STAMP:  08-19-97  19:30:34 

EVENT  SEQ.  NUMBER:  251  EVENT  TYPE:  2 _ CSC  ID:  4.01 

Status  of  the  WARP  connection  has  changed. 


comm  status:  enabled-active 


|CR3 


INPUT  MESSAGE  #:  1 

RECEIVE  TIME  (ADAS):  08/19/97  19:29:09 


C-133 


13  RMS  ID:  0x01  LOGICAL  UNIT  ID:  0x20 


15  DATE: 

08/19/97 

TIME: 

19:29:08 

22  DATAPOINT  ID: 

0x02  CONDITION  STATUS:  0x42 

24  PARAMETER  VALUE: 

(001)  Decimal 

INPUT  MESSAGE  #: 

159 

RECEIVE  TIME  (ADAS )  : 

08/19/97  19:31:17 

+++++++++++++++++++++++++++++++++++++++ 

21398  RMS  ID: 

0x01 

LOGICAL  UNIT  ID: 

0x20 

21400  DATE: 

08/19/97 

TIME: 

19:31:16 

21402  DATAPOINT  ID: 

0x02 

CONDITION  STATUS: 

0x4  0 

21404  PARAMETER  VALUE 

:  (000)  Decimal 

CR2 


ICR4 
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C.2.5.  TEST  DE-05  -  Recoverable  I/O  Init.  Error  (WMSCR) 

The  following  paragraphs  provide  information  about  data  associated  with  this 
test  but  not  included  within  the  main  body  of  this  report. 


C.2.5.1.  Associated  Evaluation  Criteria  and  Data 

The  following  Evaluation  Criteria  were  used  to  determine  the  requirements 
passed/failed.  The  Cross  Reference  (CR)  numbers  can  be  used  to  trace  into  the 
data  found/referenced  below. 

Pass  Fail 

a.  [XX]  [  ]  Each  procedure  step's  "pass"  box,  in  the  'Observed  Results' 

column,  was  marked,  indicating  the  'Expected  Response'  was 
observed.  (See  Appendix  C  for  the  test  procedure  performed 
for  test  DE-05.) 

b.  [XX]  [  ]  The  ADAS  Event  Log  must  show  that  ADAS  detected  the  off-line 

WMSCR  Simulator  CR1  and  continued  to  the  Operational  State  -  J 
Reduce  Mode  as  indicated  by  the  SYS_MODE  datapoint  in  the 
Datapoint  request  CR2  .  I 

b.  [XX]  [  ]  Three  minutes  later  (approximately)  the  WMSCR  simulator  must 

be  reported  as  active  CR3.  1 

d.  [XX]  [  ]  The  transition  from  Reduce  to  Full  Mode  must  have  occurred 

as  indicated  by  the  third  request  of  the  SYS_MODE  datapoint 
CR4  .  I 


The  following  data,  marked  with  evaluation  criteria  cross-reference  numbers, 
is  a  subset  of  the  OT&E  formal  test  run  data.  Other  relavent  data  has  been 
included  into  DE-05 's  Test  Conduct  Form  (TCF)  file,  "DE-05. TCF". 


EVENT  PRIORITY:  non-critical  DATE/TIME  STAMP:  08-19-97 
EVENT  SEQ.  NUMBER:  44  EVENT  TYPE:  12 . CSC  ID:  5.01 


Status  of  the  WMSCR  connection  has  changed. 


19:39:30 


comm  status:  enabled-failed 


EVENT  PRIORITY:  non-critical  DATE/TIME  STAMP:  08-19-97  19:42:22 

EVENT  SEQ.  NUMBER:  251  EVENT  TYPE:  12 _ CSC  ID:  5.01 

Status  of  the  WMSCR  connection  has  changed. 

comm  status:  enabled-active  _ _ _ 


INPUT  MESSAGE  #:  1 

RECEIVE  TIME  (ADAS):  08/19/97  19:41:10 
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13 

RMS  ID: 

0x01 

LOGICAL  UNIT  ID: 

0x20 

15 

DATE: 

08/19/97 

TIME: 

19:41:09 

22 

DATAPOINT  ID: 

0x02 

CONDITION  STATUS: 

0x42 

24 

PARAMETER  VALUE: 

(001)  Decimal 

INPUT 

MESSAGE  #: 

159 

RECEIVE  TIME  (ADAS)  : 

08/19/97  19:43:16 

21398 

RMS  ID: 

0x01 

LOGICAL  UNIT  ID: 

21400 

DATE: 

08/19/97 

TIME: 

21402 

DATAPOINT  ID: 

0x02 

CONDITION  STATUS: 

21404  PARAMETER  VALUE:"  (000)  Decimal 


0x20 

19:43: 1 6 
. 0x40 . 


CR4 
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C.2.6.  TEST  DE-06  -  Recoverable  I/O  Init.  Error  (CTS) 


The  following  paragraphs  provide  information  about  data  associated  with  this 
test  but  not  included  within  the  main  body  of  this  report. 


C.2.6.1.  Associated  Evaluation  Criteria  and  Data 

The  following  Evaluation  Criteria  were  used  to  determine  the  requirements 
passed/failed.  The  Cross  Reference  (CR)  numbers  can  be  used  to  trace  into  the 
data  found/referenced  below. 


Pass  Fail 

a.  [XX]  [  ]  Each  procedure  step's  "pass"  box,  in  the  'Observed  Results’ 

column,  was  marked,  indicating  the  'Expected  Response'  was 
observed.  (See  Appendix  C  for  the  test  procedure  performed 
for  test  DE-06 . ) 

b.  [XX]  [  ]  The  ADAS  Event  Log  must  show  that  ADAS  detected  the  off-line 

CTS  simulator  CR1  and  continued  to  the  Operational  State  -  j 
Reduce  Mode  as  indicated  by  the  SYS_MODE  datapoint  in  the 
datapoint  request  CR2 .  I 

c.  [XX]  [  ]  Three  minutes  later  (approximately)  the  CTS  simulator  must 

be  reported  as  active  CR3 .  I 

d.  [XX]  [  ]  The  transition  from  Reduce  to  Full  Mode  must  have  occurred 

as  indicated  by  the  third  request  of  the  SYS  MODE  datapoint 
CR4 .  I 


The  following  data,  marked  with  evaluation  criteria  cross-reference  numbers., 
is  a  subset  of  the  OT&E  formal  test  run  data.  Other  relavent  data  has  been 
included  into  DE-06's  Test  Conduct  Form  (TCF)  file,  "DE-06. TCF". 

EVENT  PRIORITY:  non-critical  DATE/TIME  STAMP:  08-19-97  21:18:45 

EVENT  SEQ.  NUMBER:  4  0  EVENT  TYPE:  10 _ CSC  ID:  2.01 

Status  of  the  signal  on  the  CTS  interface  has  changed. 

comm  status:  enabled- failed  . . . 


EVENT  PRIORITY:  non-critical  DATE/TIME  STAMP:  08-19-97  21:21:18 

EVENT  SEQ.  NUMBER:  258  EVENT  TYPE:  10 . CSC  ID:  2.01 

Status  of  the  signal  on  the  CTS  interface  has  changed. 

comm  status:  enabled-active  ;  .  _ _ _ _ _ _ _ _ _ _ _ CR3 

INPUT  MESSAGE  #:  1 

RECEIVE  TIME  (ADAS):  08/19/97  21:20:10 
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13 

15 

RMS  ID: 

DATE: 

0x01 

08/19/97 

LOGICAL  UNIT  ID: 
TIME: 

0x20 

22 

DATAPOINT  ID: 

0x02 

CONDITION  STATUS: 

0x42 

24 

PARAMETER  VALUE: 

(001)  Decimal 

82 

DATAPOINT  ID: 

6x10 

CONDITION  STATUS: 

0x42 

84 

PARAMETER  VALUE: 

(002)  Decimal 

21:20:08 


INPUT  MESSAGE  #:  159 

RECEIVE  TIME  (ADAS):  08/19/97  21:22:17 


21398  RMS  ID:  0x01 

21400  DATE:  08/19/97 

21402 . DATAPOINT  ID: . ' . 0x02 . 

214  04 . PARAMETER"  VALUE : . ""(000)"" Decimal 


LOGICAL  UNIT  ID: 
TIME: 

CONDITION”  STATUS  :’’ 


0x20 

21:22:17 
. 0x40 . 


CR2 


CR4 
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C.2.7.  TEST  DE-07  -  MPS  Communications  Error 

The  following  paragraphs  provide  information  about  data  associated  with  this 
test  but  not  included  within  the  main  body  of  this  report. 


C.2.7.1.  Associated  Evaluation  Criteria  and  Data 

The  following  Evaluation  Criteria  were  used  to  determine  the  requirements 
passed/failed.  The  Cross  Reference  (CR)  numbers  can  be  used  to  trace  into  the 
data  found/referenced  below. 

Pass  Fail 

a.  [XX]  [  ]  Each  procedure  step's  "pass"  box,  in  the  'Observed  Results' 

column,  was  marked,  indicating  the  'Expected  Response'  was 
observed.  (See  Appendix  C  for  the  test  procedure  performed 
for  test  DE-07 . ) 

b.  [XX]  [  ]  The  ADAS  Event  log  must  indicate  that  there  were  two  changes 

in  the  status  of  the  MPS  connection  -  enabled  to  disabled 
CR1  and  display  to  enabledCR2 .  I 

c.  [XX]  [  ]  The  IPS  Inbound  Message  log  must  indicate  that  the  MPS 

simulator  received  the  response  from  the  requested  Subsystem 
Status  command  CR3 .  I 

d.  [XX]  [  ]  The  IPS  Inbound  Message  log  must  indicate  that  a 

Return-to-Normal  message  was  received  for  the  MPS 
reconnection  CR4 .  I 


The  following  data,  marked  with  evaluation  criteria  cross-reference  numbers, 
is  a  subset  of  the  OT&E  formal  test  run  data.  Other  relavent  data  has  been 
included  into  DE-07 's  Test  Conduct  Form  (TCF)  file,  "DE-07. TCF". 

EVENT  PRIORITY:  non-critical  DATE/TIME  STAMP:  08-19-97  21:31:31 

EVENT  SEQ.  NUMBER:  24  5  EVENT  TYPE:  7 . CSC  ID:  6.01 

Status  of  the  MPS  connection  has  changed. 

comm  status :  enabled- failed . ; . . . , . 

EVENT  PRIORITY:  non-critical  DATE/TIME  STAMP:  08-19-97  21:33:40 

EVENT  SEQ.  NUMBER:  261  EVENT  TYPE:  7 _ CSC  ID:  6.01 

Status  of  the  MPS  connection  has ....changed^ 

comm  status:  enabled-active _ _ _ 

INPUT  MESSAGE  #:  1 

RECEIVE  TIME  (IPS):  08/19/97  21:34:07 
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RECEIVE  TIME  (ADAS):  08/19/97  21:34:07 

SIMULATOR  ID:  3 

MESSAGE  TYPE:  MPS_RTN_NORMAL 

MESSAGE  SIZE:  21 

GROUP  ID:  0 

MESSAGE  TYPE:  MPS  Return  to  Normal 


RMS  ID: 

0x01 

LOGICAL 

UNIT  ID: 

0x23 

DELIMITER: 

0x00 

MESSAGE 

FUNCTION: 

42 

DATE: 

08/19/97 

TIME: 

21:34:05 

DATAPOINT  ID: 

0x01 

CONDITION  STATUS: 

0x40 

DATA  TYPE: 

0x01 

RESOLUTION: 

0x00 

PARAMETER  VALUE: 

(002) 

Decimal 

CR4 

INPUT  MESSAGE  #: 

2 

RECEIVE  TIME  (IPS) : 

08/19/97  21:34:09 

RECEIVE  TIME  (ADAS) 

:  08/19/97  21:34:09 

SIMULATOR  ID: 

3 

MESSAGE  TYPE: 

MPS 

RTN  NORMAL 

MESSAGE  SIZE: 

26 

GROUP  ID: 

0 

MESSAGE  TYPE:  MPS  Return  to 

Normal 

RMS  ID: 

0x01 

LOGICAL 

UNIT  ID: 

0x20 

DELIMITER: 

0x00 

MESSAGE 

FUNCTION: 

42 

DATE : 

08/19/97 

TIME: 

21:34:06 

DATAPOINT  ID: 

0x02 

CONDITION  STATUS: 

0x4  0 

DATA  TYPE: 

0x01 

RESOLUTION: 

0x00 

PARAMETER  VALUE: 

(000) 

Decimal 

CR4 

INPUT  MESSAGE  #: 

1 

RECEIVE  TIME  (IPS).: 

08/19/97  21:31:27 

RECEIVE  TIME  (ADAS) 

:  08/19/97  21:31:27 

SIMULATOR  ID: 

3 

MESSAGE  TYPE: 

MPS 

SYS  STATUS 

MESSAGE  SIZE: 

27 

GROUP  ID: 

0 

MESSAGE  TYPE:  MPS  Subsystem 

Status  Data 

RMS  ID: 

0x1 

LOGICAL  UNIT  ID: 

0x25 

DELIMITER: 

0x0 

MESSAGE  FUNCTION: 

0x4b 

DATE: 

08/19/97 

TIME: 

4426562:4426564:4426566 

AVAILABILITY  STATUS 

:  (0x20)  Online  Normal 

DATAPOINT  ID: 

0x1 

CONDITION 

STATUS : 

0x40 

DATAPOINT  ID: 

0x2 

CONDITION 

STATUS : 

0x40 

DATAPOINT  ID: 

0x3 

CONDITION 

STATUS : 

6x4  0 

DATAPOINT  ID: 

0x4 

CONDITION 

STATUS : 

0x40 

DATAPOINT  ID: 

0x5 

CONDITION 

STATUS : 

0x40 

CR3 
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[RTN]  S  [UP]  [SP]  <2:[RTN]>  {wait} 

[F14] " 

12.  Output  the  IML:  MPS  RETURN  TO  NORMAL  to  file.  The  output  file  is  in  directory  ’/tmp’.  [X]  Pass  [  ]  Fail  Stop  Test 

@ISC:  ”[F7]  DE-07  <2:{RTN]>  {SP]  [RTN]  MMMM  The  Select  Log  Type  screen  is  displayed. 

<2 : [RTN] >  [wait]  [F14]" 


C.2.8.  TEST  DE-08  -  DLP/WARP  Communications  Error 

The  following  paragraphs  provide  information  about  data  associated  with  this 
test  but  not  included  within  the  main  body  of  this  report. 


C.2.8.1.  Associated  Evaluation  Criteria  and  Data 

The  following  Evaluation  Criteria  were  used  to  determine  the  requirements 
passed/failed.  The  Cross  Reference  (CR)  numbers  can  be  used  to  trace  into  the 
data  found/referenced  below. 

Pass  Fail 

a.  [XX]  [  ]  Each  procedure  step's  "pass"  box,  in  the  'Observed  Results’ 

column,  was  marked,  indicating  the  'Expected  Response'  was 
observed.  (See  Appendix  C  for  the  test  procedure  performed 
for  test  DE-08.) 

b  The  ADAS  Event  log  must  indicate  that  there  were  two  changes 

in  the  status  of  the  DLP,  WARP,  WMSCR,  and  each  ITWS 


connection . 

Failed  Active 

[XX]  [  ]  DLP  jCRIJ.  [CR2j 

[XX]  [  ]  WARP  [ CR3 ]  [CR4] 

[XX]  [  ]  WMSCR  [CR5]  [CR6] 

[XX]  [  ]  ITWS  1  [CR7]  ] CR8  ] 

[XX]  [  ]  ITWS  2  [CRS]  [CR10] 

[XX]  [  ]  ITWS  3  [CR11]  jCRlii 

[XX]  [  ]  ITWS  4  [CR13]  [CR14 ] 

[XX]  [  ]  ITWS  5  [CR15]  IcRl.6]. 

[XX]  [  ]  ITWS  6  [CR1.7]  [ CR1 8 ] 


c.  [XX]  [  ]  The  System  Mode  datapoint  must  be  reported  as  REDUCED  (LU  20 

DP  02  =  1)  after  the  connections  are  disabled  ,[CR19]_.  | 

d  [XX]  [  ]  The  communications  status  datapoint  (DP  01)  for  DLP  (LU  29) 

[CR  20],  WARP  (LU  2A)  [CR21J,  WMSCR  (LU  2B)  [CR22],  and  each 

i'TWS . (LUs  2E-33)  [CRs""~23-28] ,  must  be  reported  as 

configured- failed  (Value  =  001)  after  the  connections  are 

display. 

d.  [XX]  [  ]  The  System  Mode  datapoint  must  be  reported  as  FULL  (LU  20  DP 

02  =  0)  after  the  connections  are  re-enabled  [CRs  29  &  30] .  | 

c.  MPS  must  be  notified  of  the  ALARM  and  RETURN-TO-NORMAL  for 


DLP,  WARP, 

WMSCR,  and 

each  ITWS. 

ALARM 

R-T-N 

[XX] 

[  ]  DLP 

[CR31] 

[CR32] 

[XX] 

[  ]  WARP 

[CR33] 

[ CR34 ] 
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[XX] 

[ 

] 

WMSCR 

[CR35] 

[CR36] 

[XX] 

[ 

] 

ITWS  1 

[ CR37 ] 

[ CR38 ] 

[XX] 

[ 

] 

ITWS  2 

[CR39] 

[CR4  0] 

[XX] 

[ 

] 

ITWS  3 

[CR41] 

[ CR42 ] 

[XX] 

[ 

] 

ITWS  4 

[CR43] 

[CR44] 

[XX] 

[ 

] 

ITWS  5 

[CR4  5 ] 

[CR46] 

[XX] 

[ 

] 

ITWS  6 

[CR47] 

[CR48] 

[XX] 

[ 

] 

System  Mode 

[CR49J 

[CR50] 

The  following  data  marked  with  evaluation  criteria  cross-reference  numbers  is 
a  subset  of  the  relevant  OT&E  formal  test  run  data  that  has  been  included  into 
DE-08's  Test  Conduct  Form  (TCF)  file,  "DE-08.TCF". 

EVENT  PRIORITY:  non-critical  DATE/TIME  STAMP:  08-19-97  21:44:11 
EVENT  SEQ.  NUMBER:  247  EVENT  TYPE:  1  CSC  ID:  4.05 

connection  has  changed. 


comm  status:  enabled-failed 


EVENT  PRIORITY:  non-critical  DATE/TIME  STAMP:  08-19-97  21:46:07 

EVENT  SEQ.  NUMBER:  285  EVENT  TYPE:  1  CSC  ID:  4.05 

Status  of  the  DLP  connection  has  chanqed. 

comm  status:  enabled-active 

1 _ _ _ 

EVENT  PRIORITY:  non-critical  DATE/TIME  STAMP:  08-19-97  21:44:17 

EVENT  SEQ.  NUMBER:  249  EVENT  TYPE:  2  CSC  ID:  4.01 

Status  of  the  WARP  connection  has  chanaed. 

comm  status:  enabled-failed 

EVENT  PRIORITY:  non-critical  DATE/TIME  STAMP:  08-19-97  21:46:14 

EVENT  SEQ.  NUMBER:  290  EVENT  TYPE:  2  CSC  ID:  4.01 

Status  of  the  WARP  connection  has  changed. 

comm  status:  enabled-active 

EVENT  PRIORITY:  non-critical  DATE/TIME  STAMP:  08-19-97  21:44:09 

EVENT  SEQ.  NUMBER:  245  EVENT  TYPE:  12  CSC  ID:  5.01 

Status  of  the  WMSCR  connection  has  chanaed. 

comm  status:  enabled-failed 

EVENT  PRIORITY:  non-critical  DATE/TIME  STAMP:  08-19-97  21:46:19 

EVENT  SEQ.  NUMBER:  293  EVENT  TYPE:  12  CSC  ID:  5.01 

Status  of  the  WMSCR  connection  has  chanqed. 

comm  status:  enabled-active 

EVENT  PRIORITY:  non-critical  DATE/TIME  STAMP:  08-19-97  21:44:11 

EVENT  SEQ.  NUMBER:  246  EVENT  TYPE:  61  '  CSC  ID:  21.01 

Status  of  the  ITWS  connection  has  chanaed. 

site  id:  1006 

comm  status:  enabled-failed  - 

C-150 


EVENT  PRIORITY:  non-critical  DATE/TIME  STAMP:  08-19-97  21:44:15 
EVENT  SEQ.  NUMBER:  248  EVENT  TYPE:  61  CSC  ID:  21.01 

Status  of  the  ITWS  connection  has  changed. 

siteid:I002  . 

comm  status:  enabled-failed 

EVENT  PRIORITY:  non-critical  DATE/TIME  STAMP:  08-19-97  21:44:19 
EVENT  SEQ.  NUMBER:  250  EVENT  TYPE: 61 CSC  ID:  21.01 
Status  of  the  ITWS  connection  has  changed. 

site  id:  1004 _ _ _ _ _ _ _ 

comm  status:  enabled-failed 

EVENT  PRIORITY:  non-critical  DATE/TIME  STAMP:  08-19-97  21:44:22 
EVENT  SEQ.  NUMBER:  251  EVENT  TYPE:  61 CSC  ID:  21.01 
Status  of  the  ITWS  connection  has  changed. 

site  id:  I005__  _ _ ;  .  . . . . 

comm  status:  enabled-failed 

EVENT  PRIORITY:  non-critical  DATE/TIME  STAMP:  08-19-97  21:44:26 
EVENT  SEQ.  NUMBER:  252  EVENT  TYPE:  61  CSC  ID:  21.01 

Status  of  the_ ITWS_  connection  ha s_ changed. 

site  id:  1001  . _ . . . . . 

comm  status:  enabled-failed 

EVENT  PRIORITY:  non-critical  DATE/TIME  STAMP:  08-19-97  21:44:29 
EVENT  SEQ.  NUMBER:  253  EVENT  TYPE: 61 CSC  ID:  21.01 
Status  of  the  ITWS  connection  ha s  changed. 

site  id:  1003 

comm  status:,  enabled-failed 

EVENT  PRIORITY:  non-critical  DATE/TIME  STAMP:  08-19-97  21:46:07 
EVENT  SEQ.  NUMBER:  284  EVENT  TYPE:  61 CSC  ID:  21.01 
Status  of  the  ITWS  connection  has  changed. 

site  id:  1006  _  _____  . _  _  __  . . . . 

comm  status:  enabled-active 

EVENT  PRIORITY:  non-critical  DATE/TIME  STAMP:  08-19-97  21:46:10 

EVENT  SEQ.  NUMBER:  286  EVENT  TYPE:  61 _ CSC  ID:  21.01 

Status  of  the  ITWS  connection  has  changed. 

site  id:  1001 _ _ _ _ _ 

comm  status:  enabled-active 

EVENT  PRIORITY:  non-critical  DATE/TIME  STAMP:  08-19-97  21:46:11 

EVENT  SEQ.  NUMBER:  288  EVENT  TYPE:  61 CSC  ID:  21.01 
Status  of  the  ITWS  connection  has  changed. 

siteid:I003 

comm  status:  enabled-active 

EVENT  PRIORITY:  non-critical  DATE/TIME  STAMP:  08-19-97  21:46:12 

EVENT  SEQ.  NUMBER:  289  EVENT  TYPE:  61  CSC  ID:  21.01 

. c-T51 . 


Status  of  th?...J.TW.S._connection  has  changed . 


site 

id:  1002 

t 

comrr 

i  status:  enabled- 

active 

EVENT 

EVENT 

PRIORITY:  non-critical  DATE/TIME  STAMP:  08-19-97  21:46:14 

SEQ.  NUMBER:  291  EVENT  TYPE:  61  CSC  ID:  21.01 

Status 

of  the  ITWS  connection  has  changed. 

site 

id:  1004 

comm  status:  enabled- 

active 

EVENT 

EVENT 

PRIORITY:  non-critical  DATE/TIME  STAMP:  08-19-97  21:46:18 

SEQ.  NUMBER:  292  EVENT  TYPE:  61  CSC  ID:  21.01 

Status 

of  the  ITWS  connection  has  changed. 

site 

id:  1005 

comm 

i  status:  enabled- 

active 

INPUT  MESSAGE  #: 

RECEIVE  TIME  (ADAS) : 

158 

08/19/97  21:45:17 

21378 

RMS  ID: 

0x01 

LOGICAL  UNIT  ID: 

0x20 

21380 

DATE: 

08/19/97 

TIME: 

21:45:17 

21387 

DATAPOINT  ID: 

0x02 

CONDITION  STATUS: 

0x42 

21389 

PARAMETER  VALUE 

:  (001)  Decimal 

INPUT  MESSAGE  #: 

RECEIVE  TIME  (ADAS) : 

159 

08/19/97  21:45:18 

22163 

RMS  ID: 

0x01 

LOGICAL  UNIT  ID: 

0x29 

22165 

DATE: 

08/19/97 

TIME: 

21:45:17 

22167 

DATAPOINT  ID: 

0x01 

CONDITION  STATUS: 

0x42 

22169 

PARAMETER  VALUE 

:  (001)  Decimal 

INPUT  MESSAGE  #: 

RECEIVE  TIME  (ADAS) : 

160 

08/19/97  21:45:18 

22198 

RMS  ID: 

0x01 

LOGICAL  UNIT  ID: 

0x2a 

22200 

DATE: 

08/19/97 

TIME: 

21:45:17 

22202 

DATAPOINT  ID: 

0x01 

CONDITION  STATUS: 

0x42 

22204 

PARAMETER  VALUE 

:  (001)  Decimal 

INPUT  MESSAGE  #: 

RECEIVE  TIME  (ADAS) : 

161 

08/19/97  21:45:18 

22233 

RMS  ID: 

0x01 

LOGICAL  UNIT  ID: 

0x2b 

22235 

DATE: 

08/19/97 

TIME: 

21:45:18 

22237 

DATAPOINT  ID: 

0x01 

CONDITION  STATUS: 

0x42 

22239 

PARAMETER  VALUE 

:  (001)  Decimal 

INPUT  MESSAGE  #: 

RECEIVE  TIME  (ADAS): 

162 

08/19/97  21:45:19 

22263 

RMS  ID: 

0x01 

LOGICAL  UNIT  ID: 

0x2e 

22265 

DATE: 

08/19/97 

TIME: 

21:45:18 

22267 

DATAPOINT  ID: 

0x01 

CONDITION  STATUS: 

0x42 

22269 

PARAMETER  VALUE 

:  (001)  Decimal 

C-152 


INPUT  MESSAGE  #:  163 

RECEIVE  TIME  (ADAS):  08/19/97  21:45:19 


+++++H 

22303 

RMS  ID: 

0x01 

LOGICAL  UNIT  ID: 

0x2f 

22305 

DATE: 

08/19/97 

TIME: 

21:45:18 

22307 

DATAPOINT  ID: 

0x01 

CONDITION  STATUS: 

0x42 

22309 

PARAMETER  VALUE 

:  (001)  Decimal 

INPUT 

MESSAGE  #: 

164 

RECEIVE  TIME  (ADAS) : 

08/19/97  21:45:19 

22343 

rTITTlTlIrllllll  1  « 

RMS  ID: 

0x01 

LOGICAL  UNIT  ID: 

0x30 

22345 

DATE: 

08/19/97 

TIME: 

21:45:19 

22347 

DATAPOINT  ID: 

0x01 

CONDITION  STATUS: 

0x42 

22349  ' PARAMETER  VALUE : ’  (001)  Decimal 


INPUT  MESSAGE  #:  165 

RECEIVE  TIME  (ADAS):  08/19/97  21:45:20 


22383  RMS  ID:  0x01 

22385  DATE:  . 08/19/97 

’223  8  7 . DATAPOINT  ID: .  6x01 _ 

22389  PARAMETER  VALUE:'  ’  (001)  Decimal 


LOGI  CAL  UNIT  ID : . 0x31 

TIME:  .  21:45:19 

" ’  CONDITION "STATUS :  6x42 


INPUT  MESSAGE  #:  166 

RECEIVE  TIME  (ADAS):  08/19/97  21:45:20 


22423  RMS  ID:  0x01 

22425  DATE:  08/19/97 . 

22427 . DATAPOINT  ID : .  Ox 6 1  . . 

2242  9  PARAMETER  VALUE':”'  ’  (OOi)  Decimal 


LOGICAL  UNIT  ID: . 0x32 

TIME : .  21:45:19 

CONDI T ION  "STATUS:  6x42 


INPUT  MESSAGE  #:  167 

RECEIVE  TIME  (ADAS):  08/19/97  21:45:21 


22463  RMS  ID:  0x01 

22465  DATE:  08/ 19/ 97 


LOGI  CAL  UN  I  T  I  D : . 0x33 

TIME: .  21:45:19 


INPUT  MESSAGE  #:  168 

RECEIVE  TIME  (ADAS):  08/19/97  21:47:34 


+++++^ 

22503 

RMS  ID: 

++t+++ttttTTTTTT 

0x01 

LOGICAL  UNIT  ID: 

0x20 

22505 

DATE: 

08/19/97 

TIME: 

21:47:32 

22507 

DATAPOINT  ID: 

6x02 

CONDITION  STATUS: 

0x40 

22509 

PARAMETER  VALUE 

:  (000)  Decimal 

INPUT 

MESSAGE  # : 

169 

RECEIVE  TIME  (ADAS) : 

08/19/97  21:47:39 

22523 

RMS  ID: 

0x01 

LOGICAL  UNIT  ID: 

0x20 

22525 

DATE: 

08/19/97 

TIME: 

21:47:33 

22532 

DATAPOINT  ID: 

0x02 

CONDITION  STATUS: 

0x40 

22534  PARAMETER  VALUE'T" . ( 0 1 0  0 IJ i  De  c ima 1 1 


INPUT  MESSAGE  #: 


1 


C- 153 


RECEIVE  TIME  (IPS) 

:  08/19/97  21:44:30 

RECEIVE  TIME  (ADAS ; 

1  :  08/19/97  21:44:30 

SIMULATOR  ID: 

3 

MESSAGE  TYPE: 

MPS 

ALARM 

MESSAGE  SIZE: 

21 

GROUP  ID: 

0 

MESSAGE  TYPE:  MPS  Alarm 

RMS  ID: 

DELIMITER: 

0x01 

LOGICAL  UNIT  ID: 

0x29 

0x00 

MESSAGE  FUNCTION: 

41 

DATE: 

08/19/97 

TIME: 

21:44:29 

DATAPOINT  ID: 

0x01 

CONDITION  STATUS: 

0x42 

DATA  TYPE: 

0x01 

RESOLUTION: 

0x00 

PARAMETER  VALUE: 

(001) 

Decimal 

(01)  Hex 

(  ) 

Ascii 

INPUT  MESSAGE  #: 

2 

RECEIVE  TIME  (IPS) : 

08/19/97  21:44:31 

RECEIVE  TIME  (ADAS) 

:  08/19/97  21:44:31 

SIMULATOR  ID: 

3 

MESSAGE  TYPE: 

MPS  ALARM 

MESSAGE  SIZE: 

21 

GROUP  ID: 

0 

MESSAGE  TYPE:  MPS  Alarm 

RMS  ID: 

DELIMITER: 

0x01 

LOGICAL  UNIT  ID: 

0x2b 

0x00 

MESSAGE  FUNCTION: 

.  41 

DATE: 

08/19/97 

TIME: 

21:44:29 

DATAPOINT  ID: 

0x01 

CONDITION  STATUS: 

0x42 

DATA  TYPE: 

0x01 

RESOLUTION: 

0x00 

PARAMETER  VALUE: 

(001) 

Decimal 

(01)  Hex 

(  ) 

Ascii 

INPUT  MESSAGE  #: 

3 

RECEIVE  TIME  (IPS) : 

08/19/97  21:44:31 

RECEIVE  TIME  (ADAS) 

:  08/19/97  21:44:31 

SIMULATOR  ID: 

3 

MESSAGE  TYPE: 

MPS  ALARM 

MESSAGE  SIZE: 

21 

GROUP  ID: 

0 

MESSAGE  TYPE:  MPS  Alarm 

RMS  ID: 

DELIMITER: 

0x01 

LOGICAL  UNIT  ID: 

0x2e 

0x00 

MESSAGE  FUNCTION: 

41 

DATE: 

08/19/97 

TIME: 

21:44:29 

DATAPOINT  ID: 

0x01 

CONDITION  STATUS: 

0x42 

DATA  TYPE: 

0x01 

RESOLUTION: 

0x00 

PARAMETER  VALUE: 

(001) 

Decimal 

(01)  Hex 

(  ) 

Ascii 

INPUT  MESSAGE  #: 

4 

C-154 


RECEIVE  TIME  (IPS):  08/19/97  21:44:31 

RECEIVE  TIME  (ADAS):  08/19/97  21:44:31 

SIMULATOR  ID:  3 

MESSAGE  TYPE:  MPS_ALARM 

MESSAGE  SIZE:  21 

GROUP  ID:  0 

MESSAGE  TYPE:  MPS  Alarm 


(01)  Hex 
(  )  Ascii 


INPUT  MESSAGE  #:  5 

RECEIVE  TIME  (IPS):  08/19/97  21:44:31 

RECEIVE  TIME  (ADAS):  08/19/97  21:44:31 

SIMULATOR  ID:  3 

MESSAGE  TYPE:  MPS_ALARM 

MESSAGE  SIZE:  21 

GROUP  ID:  0 

MESSAGE  TYPE:  MPS  Alarm 

RMS  ID:  0x01  LOGICAL  UNIT  ID: . 0x30 

DELIMITER:  0x00  MESSAGE  FUNCTION:-  41 

DATE :  08/19/97 . ,m . TIME: . , . . ; . 21:44:29 

. pATAPOINT  ID: . 6x01  CONDITION  STATUS; . 0x42 

. DATA  TYPE  : .  6x01  RESOLUTION  : _ 6x66 

PARAMETER  VALUE:  ("6 0 1 )  De cima  1  . . 

. . (6 lT  Hex 

(  )  Ascii 


INPUT  MESSAGE  #:  6 

RECEIVE  TIME  (IPS):  08/19/97  21:44:31 

RECEIVE  TIME  (ADAS):  08/19/97  21:44:31  ■ 

SIMULATOR  ID:  3 

MESSAGE  TYPE:  MPS_ALARM 

MESSAGE  SIZE:  21 

GROUP  ID:  0 

MESSAGE  TYPE:  MPS  Alarm 

RMS  ID:  0x01  LOGICAL  UNIT  ID: . 0x31 

DELIMITER:  0x00  MESSAGE  FUNCTION:  41 

DATE:  08/19/97  TIME:  21:44:29 

pATAPOINT  ID:  "  6x01  CONDITION  STATUS: . 0x42 

. DATA  TYPE: .  6x01  RESOLUTION: . . 6x65 

. PARAMETER' ^  VALUE: . (001*) Decimal  _ 

(01)  Hex 
(  ) .  Ascii 


INPUT  MESSAGE  #:  7 

RECEIVE  TIME  (IPS):  08/19/97  21:44:31 

C-155 


RECEIVE  TIME 

(ADAS):  08/19/9721:44:31 

SIMULATOR  ID: 

3 

MESSAGE  TYPE: 

MPS 

ALARM 

MESSAGE  SIZE: 

21 

GROUP  ID: 

0 

MESSAGE  TYPE: 

MPS 

Alarm 

RMS  ID: 

0x01 

LOGICAL  UNIT  ID: 

0x32 

DELIMITER: 

0x00 

MESSAGE  FUNCTION: 

41 

DATE: 

08/19/97 

TIME : 

21:44:29 

DATAPOINT  ID: 

0x01 

CONDITION  STATUS: 

0x42 

DATA  TYPE: 

0x01 

RESOLUTION: 

0x00 

PARAMETER  VALUE: 

(001) 

Decimal 

(01)  Hex 

(  ) 

Ascii 

INPUT  MESSAGE  # 

: 

8 

RECEIVE  TIME 

(IPS) 

:  08/19/97  21:44:31 

RECEIVE  TIME 

(ADAS 

) :  08/19/97  21:44:31 

SIMULATOR  ID: 

3 

MESSAGE  TYPE: 

MPS 

ALARM 

MESSAGE  SIZE: 

21'- 

GROUP  ID: 

0 

MESSAGE  TYPE: 

MPS 

Alarm 

RMS  ID: 

0x01 

LOGICAL  UNIT  ID: 

0x33 

DELIMITER: 

0x00 

MESSAGE  FUNCTION: 

41 

DATE: 

08/19/97 

TIME: 

21:44:29 

DATAPOINT  ID: 

0x01 

CONDITION  STATUS: 

0x42 

DATA  TYPE: 

0x01 

RESOLUTION: 

0x00 

PARAMETER  VALUE: 

(001) 

Decimal 

(01)  Hex 

<  ) 

Ascii 

INPUT  MESSAGE  # 

: 

9 

RECEIVE  TIME 

(IPS) 

:  08/19/97  21:44:32 

RECEIVE  TIME 

(ADAS 

) :  08/19/97  21:44:32 

SIMULATOR  ID: 

3 

MESSAGE  TYPE: 

MPS  ALARM 

MESSAGE  SIZE: 

21 

GROUP  ID: 

0 

MESSAGE  TYPE: 

MPS 

Alarm 

RMS  ID: 

0x01 

LOGICAL  UNIT  ID: 

0x2a 

DELIMITER: 

0x00 

MESSAGE  FUNCTION: 

41 

DATE: 

08/19/97 

TIME: 

21:44:30 

DATAPOINT  ID: 

0x01 

CONDITION  STATUS: 

0x42 

DATA  TYPE: 

0x01 

RESOLUTION: . 

0x00 

PARAMETER  VALUE:  (001)  Decimal 

. ( 01 j  Hex . 

(  )  Ascii 


INPUT  MESSAGE  #:  10 

RECEIVE  TIME  (IPS):  08/19/97  21:44:33 

RECEIVE  TIME  (ADAS):  08/19/97  21:44:33 

C-156 


SIMULATOR  ID:  3 


MESSAGE  TYPE: 

MPS  ALARM 

MESSAGE  SIZE: 

41 

GROUP  ID: 

0 

MESSAGE  TYPE: 

MPS 

Alarm 

RMS  ID: 

0x01 

LOGICAL  UNIT  ID: 

0x20 

DELIMITER: 

0x00 

MESSAGE  FUNCTION: 

41 

DATE: 

08/19/97 

TIME: 

21:44:31 

DATAPOINT  ID: 

0x02 

CONDITION  STATUS: 

0x42 

DATA  TYPE: 

0x01 

RESOLUTION: 

0x00 

PARAMETER  VALUE: 

(001)  Decimal 

(01)  Hex 

(  )  Ascii 

INPUT  MESSAGE  # 

1 

RECEIVE  TIME 

(IPS) 

:  08/19/97  21: 

47:06 

RECEIVE  TIME 

(ADAS) :  08/19/97  21: 

47:06 

SIMULATOR  ID: 

3 

MESSAGE  TYPE: 

MPS  RTN_NORMAL 

MESSAGE  SIZE: 

21 

GROUP  ID: 

0 

MESSAGE  TYPE: 

MPS 

Return  to  Normal 

RMS  ID: 

0x01 

LOGICAL  UNIT  ID: 

0x29 

DELIMITER: 

0x00 

MESSAGE  FUNCTION: 

42 

DATE: 

08/19/97 

TIME: 

21:47:05 

DATAPOINT  ID: 

CONDITION  STATUS: 

0x40 

DATA  TYPE: 

RESOLUTION: 

0x00 

PARAMETER  VALUE: 

(002)  Decimal 

_ _ 

. . 

(02)  Hex 

(  )  Ascii 

INPUT  MESSAGE  # 

: 

2 

RECEIVE  TIME 

(IPS) 

:  08/19/97  21: 

47:06 

RECEIVE  TIME 

(ADAS):  08/19/97  21: 

47:06 

SIMULATOR  ID: 

3 

MESSAGE  TYPE: 

MPS  RTN  NORMAL 

MESSAGE  SIZE: 

21 

GROUP  ID: 

0 

MESSAGE  TYPE: 

MPS 

Return  to  Normal 

RMS  ID: 

0x01 

LOGICAL  UNIT  ID: 

0x2a 

DELIMITER: 

0x00 

MESSAGE  FUNCTION: 

42 

DATE: 

08/19/97 

TIME: 

21:47:05 

DATAPOINT  ID: 

0x01 

CONDITION  STATUS: 

0x40 

DATA  TYPE: 

0x01 

RESOLUTION: 

0x00 

PARAMETER  VALUE:  (002)  Decimal 


(02)  Hex 
(  )  Ascii 


INPUT  MESSAGE  #:  3 

08/19/97  21:47:06 
08/19/97  21:47:06 
3 

MPS_RTN_NORMAL 

C-157 


RECEIVE  TIME  (IPS) : 
RECEIVE  TIME  (ADAS) : 
SIMULATOR  ID: 
MESSAGE  TYPE: 


MESSAGE  SIZE:  -  21 

GROUP  ID:  0 

MESSAGE  TYPE:  MPS  Return  to  Normal 


RMS  ID: 
DELIMITER: 


DATE 


DATAPOINT  ID 


DATA  TYPE 


PARAMETER  VALUE 


0x01 

0x00 


08/19/97 


0x01 


0x01 


002) 


Decimal 


(02)  Hex 


Ascii 


LOGICAL  UNIT_  ID: 
MESSAGE '"FUNCTION : 


TIME 


CONDITION  STATUS 


RESOLUTION 


0x2b 

42 


21:47:05 


0x40 


0x00 


INPUT  MESSAGE  #: 


RECEIVE  TIME  (IPS) : 
RECEIVE  TIME  (ADAS) 
SIMULATOR  ID: 
MESSAGE  TYPE: 
MESSAGE  SIZE: 

GROUP  ID: 


08/19/97  21:47:06 
08/19/97  21:47:06 
3 

MPS_RTN_NORMAL 

21 

0 


MESSAGE  TYPE:  MPS  Return  to  Normal 


RMS  ID: 
DELIMITER: 


DATE 


DATAPOINT  ID 


DATA  TYPE 


PARAMETER  VALUE 


0x01 

0x00 

"08/19/97  . 

. Ox 01 . 


0x01 


(002)  Decimal 


(02)  Hex 
(  )  Ascii 


LOGICAL  UNIT  ID: 
MESSAGE  FUNCTION : 

"TIME:  "  . 

CON  D I T I  O  N  S  T  AT  U  s  ": 


RESOLUTION 


0x2e 
_  42 

"21:47:05 

""""6x40 . 


0x00 


INPUT  MESSAGE  #: 

RECEIVE  TIME  (IPS) : 
RECEIVE  TIME  (ADAS) 
SIMULATOR  ID: 
MESSAGE  TYPE: 
MESSAGE  SIZE: 

GROUP  ID: 


08/19/97  21:47:06 
08/19/97  21:47:06 
3 

MPS_RTN_NORMAL 

21 

0 


MESSAGE  TYPE:  MPS  Return  to  Normal 


RMS  ID: 
DELIMITER: 
DATE: '  _ 


DATAPOINT  ID 


DATA  TYPE 


PARAMETER  VALUE: 


0x01 

0x00 

6  8"/ 19?  9  7 


0x01 


0x01 


(002)  Decimal 
(02)  Hex 
(  )  Ascii 


LOGICAL  UNIT  ID: 
MESSAGE  FUNCTION : 
TIME: . 


CONDITION  STATUS 


RESOLUTION 


0x2  f 

. 42 . 

"21:47:05 


0x40 


0x00 


INPUT  MESSAGE  #:  6 

RECEIVE  TIME  (IPS):  08/19/97  21:47:06 

RECEIVE  TIME  (ADAS):  08/19/97  21:47:06 

SIMULATOR  ID:  3 

MESSAGE  TYPE:  MPS_RTN  NORMAL 

MESSAGE  SIZE:  21 


C-158 


GROUP  ID:  0 

MESSAGE  TYPE:  MPS  Return  to  Normal 


RMS  ID: 
DELIMITER: 


DATE: 


DATAPOINT  ID 


DATA  TYPE 


PARAMETER  VALUE 


0x01 

0x00 

08/19/97 


0x01 


SEE 

m 


Decimal 


(02)  Hex 
(  )  Ascii 


LOGI CAL  UNIT  ID: 
MESSAGE "FUNCTION : 

time” 


CONDITION  STATUS 


RESOLUTION 


0x30 

42 


21:47:05 


0x4  0 


0x00 


INPUT  MESSAGE  #: 


RECEIVE  TIME  (IPS) : 
RECEIVE  TIME  (ADAS) 
SIMULATOR  ID: 
MESSAGE  TYPE: 
MESSAGE  SIZE: 

GROUP  ID: 

MESSAGE  TYPE:  MPS  F 
RMS  ID: 

DELIMITER: 


DATE 


DATAPOINT  ID 


DATA  TYPE 


PARAMETER  VALUE 


IPS) :  08/19/97  21:47:06 

ADAS):  08/19/97  21:47:06 

3 

MPS_RTN_NORMAL 

21 

0 

MPS  Return  to  Normal 

0x01  LO 

0x00  ME 


08/19/97  TI 


(002)  Decimal 


(02)  Hex 
(  )  Ascii 


LOGICAL  UNIT  ID: 
MESSAGE  FUNCTION : 


TIME 


CONDITION  STATUS 


RESOLUTION 


0x31 
. 42 . 

21:47:05 


0x40 


0x00 


INPUT  MESSAGE  #: 

RECEIVE  TIME  (IPS) : 
RECEIVE  TIME  (ADAS) 
SIMULATOR  ID: 
MESSAGE  TYPE: 
MESSAGE  SIZE: 

GROUP  ID: 


08/19/97  21:47:07 
08/19/97  21:47:07 
3 

MPS_RTN_NORMAL 

21 

0 


MESSAGE  TYPE:  MPS  Return  to  Normal 


RMS  ID: 
DELIMITER: 


DATE 


DATAPOINT  ID 


DATA  TYPE 


0x01 

0x00 


08/19/97 


0x01 


0x01 


LOGICAL  UNIT  ID:_ 
MESSAGE  FUNCTION: 


TIME 


CONDITION  STATUS 


RESOLUTION 


0x32 
. 42 . 


21:47:05 


0x40 


0x00 


PARAMETER  VALUE:  (002)  Decimal 


(02)  Hex 
(  )  Ascii 


INPUT  MESSAGE  #:  9 

RECEIVE  TIME  (IPS):  08/19/97  21:47:08 

RECEIVE  TIME  (ADAS):  08/19/97  21:47:08 

SIMULATOR  ID:  3 

MESSAGE  TYPE:  MPS_RTN_NORMAL 

MESSAGE  SIZE:  21 

GROUP  ID:  0 


C-159 


MESSAGE  TYPE:  MPS 
RMS  ID: 

DELIMITER: 

DATE:  _ ” 

DATAPOINT  ID: 

DATA  TYPE: . 

PARAMETER"' 'value”:”" 


Return  to  Normal 
0x01 
0x00 

”08/19797 

0x01 

. . 6x01 . T . 

_ (002) _ Decimal 

. (02)  Hex” 

(  )  Ascii 


LOGICAL  UNIT  ID: 
MESSAGE” FUNCTION 

TIME: . . 

CONDITION  STATUS 
RESOLUTION':”” . 


0x33 
. j42 . 

21:47:05 
0x40 
. 0x00 


INPUT  MESSAGE  #:  10 

RECEIVE  TIME  (IPS):  08/19/97  21:47:09 

RECEIVE  TIME  (ADAS):  08/19/97  21:47:09 

SIMULATOR  ID:  3 

MESSAGE  TYPE:  MPS_RTN_NORMAL 

MESSAGE  SIZE:  41 

GROUP  ID:  0 

MESSAGE  TYPE:  MPS  Return  to  Normal 

RMS  ID:  0x01  LOGICAL  UNIT  ID:  0x20 

. DELIMITER:  .  0x00  MESSAGE  FUN  CT I  ON: . 42 . 

DATE:  . . 08/19/97 . TIME”: . ""21747 :  06 

_ DATAPOINT  ID: . 0x02  CONDITION  STATUS:  0x4  0 

. DATA  TYPE:  ”  0x61  . RESOLUTION:' . 0x66 

. PARAMETER  VALUE:  . (666) . Decimal . . . : . ■ . 

. (66  j  Hex . . . . . . . ; . 

(  )  Ascii 
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C.2.9.  TEST  DE-10  -  CTS  Communications  Error 

The  following  paragraphs  provide  information  about  data  associated  with  this 
test  but  not  included  within  the  main  body  of  this  report. 


C.2.9.1.  Associated  Evaluation  Criteria  and  Data 

The  following  Evaluation  Criteria  were  used  to  determine  the  requirements 
passed/failed.  The  Cross  Reference  (CR)  numbers  can  be  used  to  trace  into  the 
data  found/referenced  below. 

Pass  Fail 

a.  [XX]  [  ]  Each  procedure  step's  "pass"  box,  in  the  'Observed  Results’ 

column,  was  marked,  indicating  the  'Expected  Response'  was 
observed.  (See  Appendix  C  for  the  test  procedure  performed 
for  test  DE-10 . ) 

b.  [XX]  [  ]  There  must  be  Event  log  entries  for  the  two  changes  in  the 

status  of  the  CTS  interface;  initial  loss  of  connection  CR1 
and  the  subsequent  reconnection  CR2 . 

c.  [XX]  [  ]  An  Event  log  entry  will  show  that  ADAS  reset  the  time  in 

response  to  the  five  minute  "shift"  in  the  CTS  time  signal 
CR3 .  ADAS  Event  log  must  indicate  that  ADAS  synchronized 
with  CTS (IPS)  [ CR4  compared  to  CR5] . 

d.  [XX]  [  ]  The  MPS  simulator  must  receive  the  ALARM  CR6  and 

Return-to-Normal  messages  CR7 . 


The  following  data,  marked  with  evaluation  criteria  cross-reference  numbers, 
is  a  subset  of  the  OT&E  formal  test  run  data.  Other  relavent  data  has  been 
included  into  DE-10 's  Test  Conduct  Form  (TCF)  file,  "DE-10. TCF". 


EVENT 

PRIORITY:  non-critical 

DATE/TIME 

STAMP: 

08-19-97  22:14:14 

CR5 

EVENT 

SEQ.  NUMBER:  292  EVENT 

TYPE:  9 

CSC 

ID:  2.01 

ADAS 

time  has  been  reset  by  CTM. 

CR3 

current  time:  08-19-97  22:09:13 

new  time:  08-19-97  22:14:14  . . . 


EVENT  PRIORITY:  non-critical  DATE/TIME  STAMP:  08-19-97  22:06:54 

EVENT  SEQ.  NUMBER:  266  EVENT  TYPE:  10 . CSC  ID:  2.01 

Status  of  the  signal  on  the  CTS  interface  has  changed. 

comm  status:  enabled-f ailed . . 

EVENT  PRIORITY:  non-critical  DATE/TIME  STAMP:  08-19-97  22:08:46 

EVENT  SEQ.  NUMBER:  282  EVENT  TYPE:  10  CSC  ID:  2.01  | 
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Status  of  the  signal 

on  the  CTS  interface  has  chanaed. 

comm  status:  enabled-active 

CR2 

INPUT  MESSAGE  #: 

1 

RECEIVE  TIME  (IPS) : 

08/19/97  22:05:08 

RECEIVE  TIME  (ADAS) 

:  08/19/97  22:07:08 

SIMULATOR  ID: 

3 

MESSAGE  TYPE: 

MPS 

ALARM 

MESSAGE  SIZE: 

21 

GROUP  ID: 

0 

MESSAGE  TYPE:  MPS  Alarm 

RMS  ID: 

0x01 

LOGICAL  UNIT  ID: 

0x2c 

DELIMITER: 

0x00 

MESSAGE  FUNCTION: 

41 

DATE: 

08/19/97 

TIME: 

22:07:05 

DATAPOINT  ID: 

0x01 

CONDITION  STATUS: 

0x42 

DATA  TYPE: 

0x01 

RESOLUTION: 

0x00 

PARAMETER  VALUE: 

(001) 

Decimal 

CR6 

(01)  Hex 

(  ) 

Ascii 

INPUT  MESSAGE  #: 

2 

RECEIVE  TIME  (IPS) : 

08/19/97  22:07:08 

RECEIVE  TIME  (ADAS) 

:  08/19/97  22:14:08 

SIMULATOR  ID: 

3 

MESSAGE  TYPE: 

MPS 

RTN  NORMAL 

MESSAGE  SIZE: 

21 

GROUP  ID: 

0 

MESSAGE  TYPE:  MPS  Return  to 

Normal 

RMS  ID: 

0x01 

LOGICAL  UNIT  ID: 

0x2c 

DELIMITER: 

0x00 

MESSAGE  FUNCTION: 

42 

DATE: 

08/19/97 

TIME: 

22:09:05 

DATAPOINT  ID: 

0x01 

CONDITION  STATUS: 

0x40 

DATA  TYPE: 

0x01 

RESOLUTION: 

0x00 

PARAMETER  VALUE: 

(002) 

Decimal 

CR7 

(02)  Hex 
(  )  Ascii 
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11.  When  prompted  by  the  IPS,  login,  report  event  [X]  Pass  [  ]  Fail  Stop  Test 

log  event  type  9  S  10  entries,  logout,  then 
acknowledge  the  IPS  prompt. 

@ISI:  "(wait)  [F7 ] ”  The  event  is  displayed  at  the  ISI. 
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C.2. 10.  TEST  DE-1 4  -  External  Error  Events 

The  following  paragraphs  provide  information  about  data  associated  with  this 
test  but  not  included  within  the  main  body  of  this  report. 


C.2.10.1.  Associated  Evaluation  Criteria  and  Data 

The  following  Evaluation  Criteria  were  used  to  determine  the  requirements 
passed/failed.  The  Cross  Reference  ( CR)  numbers  can  be  used  to  trace  into  the 
data  found/referenced  below. 

Pass  Fail 

a.  [XX]  [  ]  Each  procedure  step's  "pass"  box,  in  the  'Observed  Results' 

column,  was  marked,  indicating  the  ’Expected  Response'  was 
observed.  (See  Appendix  C  for  the  test  procedure  performed 
for  test  DE-14 . ) 

b.  [XX]  [  ]  Successful  completion  of  the  manual  procedures  for  this  test 

case  indicates  the  ASC  reflected  the  occurrence  of  the  file 
error  event. 

c.  [XX]  [  ]  Successful  completion  of  the  manual  procedures  for  this  test 

case  indicates  the  second  Erroneous  Message  event  did  not 
appear  on  the  ASC  while  it  was  logged  off. 

d.  [XX]  [  ]  Three  type  21  and  one  type  43  events  must  appear  in  the 

Event  Log  File  CR1-3  &  CR4 .  | 

e.  [XX]  [  ]  Each  of  the  Event  notifications  must  properly  identify  the 

associated  event  as  in  CR5.  I 


The  following  data,  marked  with  evaluation  criteria  cross-reference  numbers, 
is  a  subset  of  the  OT&E  formal  test  run  data.  Other  relavent  data  has  been 
included  into  DE-14 's  Test  Conduct  Form  (TCF)  file,  "DE-14. TCF", 


EVENT  PRIORITY:  non-critical  DATE/TIME  STAMP:  08-19-97  22:38:15 

EVENT  SEQ.  NUMBER:  259  EVENT  TYPE:  21  CSC  ID:  11.02 . . 

An  erroneous  message  has  been  triggered  by  System  Logging.  . 


message  type:  ADAS  received  erroneous  message 
error  type:  MPS  requ e s t _  er r o r  cod e :  Invalid  reque 
original  csc_id:  10.03  error  number:  1 
error  offset:  6 


EVENT  PRIORITY:  non-critical  DATE/TIME  STAMP:  08-19-97  22:39:03 

EVENT  SEQ.  NUMBER:  262  EVENT  TYPE:  21  CSC  ID:  11.02___ _ |CR2 

An  erroneous  message  has  been  triggered  by  System  Logging. 

interface  id:  K001  message  type:  ADAS  received  erroneous  message 


C-167 


message  error  code:  Time  exception 
original  esc  id;  3. 02  error  n umb e r :  2 
error  offset:  36 


EVENT  PRIORITY:  non-critical  DATE/TIME  STAMP:  08-19-97  22:42:02 
EVENT  SEQ.  NUMBER:  289  EVENT  TYPE:  21  CSC  ID:  11.02 


An  erroneous  message  has 


interface  id:  K001 message  type:  ADAS  received  erroneous  message 
error  type:  AWOS  weather  message  error  code:  Time  exception 

original  esc  id:  3.02  error  number: _ 3 

error  offset:  136 


CR3 


ICR5 


EVENT  PRIORITY:  critical  DATE/TIME  STAMP:  08-19-97  22:44:28 

EVENT  SEQ.  NUMBER:  317  EVENT  TYPE:  43  CSC  ID:  13.04 _ |CR4 

Disk  I/O  error  detected  while  attempting  to  access  __a  file. 

file  name:  /usr/adas/adasrun/data/SS/adb  env  prm  CR5 
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22.  Issue  the  command  to  Shutdown  IPS.  The  ISI  shuts-down  and  the  ISC  displays  [X]  Pass  [  ]  Fail  Stop  Test 

@ISC:  " [F8]  [F10]  [SP]  [RTN] "  a  ’login’  prompt. 
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C.2.11.  TEST  DE-15-CTS  Error 


The  following  paragraphs  provide  information  about  data  associated  with  this 
test  but  not  included  within  the  main  body  of  this  report. 


C.2.11.1.  Associated  Evaluation  Criteria  and  Data 

The  following  Evaluation  Criteria  were  used  to  determine  the  requirements 
passed/failed.  The  Cross  Reference  (CR)  numbers  can  be  used  to  trace  into  the 
data  found/ referenced  below. 

Pass  Fail 

a-  [XX]  [  ]  Each  procedure  step's  "pass"  box,  in  the  'Observed  Results' 

column,  was  marked,  indicating  the  'Expected  Response'  was 
observed.  (See  Appendix  C  for  the  test  procedure  performed 
for  test  DE-15 . ) 

b.  [XX]  [  ]  The  7  identified  CTS  events  are  reported  via  the  SI  CR1  - 

CR7  and  in  the  Event  Log  CR8  -  CR14 

c.  [XX]  [  ]  The  description  must  properly  identify  the  event  as  in  type 

8  CR1S&CR17 ,  type  10  CR16  &  CR18. 


The  following  data,  marked  with  evaluation  criteria  cross-reference  numbers, 
is  a  subset  of  the  OT&E  formal  test  run  data.  Other  relavent  data  has  been 

included  into  DE-15' s  Test  Conduct  Form  (TCF)  file,  "DE-15. TCF". 

08-20-97  18:27:31  .  Events:  9  .  Responses:  0  .  ESCAPE  CMDS 

. . . . . .  DISPLAY  NEXT  EVENT  MESSAGE 

.EVENT  PRIORITY:  non-critical  DATE/TIME  STAMP:  08-20-97  18:27:22 

.EVENT  SEQ.  NUMBER:  369  EVENT  TYPE:  8  CSC  ID:  2.01  CR1 

. error . has  occurred  on  the  CTS  interface. 

• . comm  status :  invalid  CTS  msg  recvd  CR15 

08-20-97  18:28:44  .  Events:  2  .  Responses:  0  .  ESCAPE  CMDS 

. . . . .  DISPLAY  NEXT  EVENT  MESSAGE 

.EVENT  PRIORITY:  non-critical  DATE/TIME  STAMP:  08-20-97  18:28:12 
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.EVENT  SEQ.  NUMBER:  386  EVENT  TYPE:  ,  10  CSC  ID:  2.01  CR2  ] 

.Status  _  of  the _ s ignal _ on  the _ CTS _ interface  has  changed. 

.  comm  status:  enabled-failed 

.  08-20-97  18:28:57  .  Events:  1  .  Responses:  0  .  ESCAPE  CMDS 

.  m  m  . . . . .  DISPLAY  NEXT  EVENT  MESSAGE 

.EVENT  PRIORITY:  non-critical  DATE/TIME  STAMP:  08-20-97  18:28:55 

.EVENT  SEQ.  NUMBER:  387  EVENT . TYPE: . 10 . . .  CSC  ID: _ 2_._01  | 

'.Status  of  the  signal  on . the  CTS  . interface . has  . . changed.. 


comm 


status : 


enabled- active 


CR3 


08-20-97  18:30:20  .  Events:  1  .  Responses:  0  .  ESCAPE  CMDS 

. .  DISPLAY  NEXT  EVENT  MESSAGE 

EVENT  PRIORITY:  non-critical  DATE/TIME  STAMP:  08-20-97  18:30:13 

EVENT  SEQ.  NUMBER:  4  01  EVENT  TYPE: _ 10 _ csc  ID: _ ?  -..91. 

.Status  of  the  signal  on  the  CTS . i.5.h®tface . has . ;.„.changed.. 


status : 


enabled-failed 


CR4 


.  08-20-97  18:31:00  .  Events:  1  .  Responses:  0  .  ESCAPE  CMDS 

. . . .  DISPLAY  NEXT  EVENT  MESSAGE 

•EVENT  PRIORITY:  non-critical  DATE/TIME  STAMP:  08-20-97  18:30:57 

.EVENT  SEQ.  NUMBER:  402  EVENT  TYPE:  10  . . . CSC . ID: _ 2.01 

Tstatus  of _ the  signal  on  the _ CTS _ interface  _ has  _ changed. 


_ comm  status: _ enabled- active 

08-20-97  18:32:25  .  Events:  1  .  Responses: 

. . .  DISPLAY  NEXT 


CR5 

0  .  ESCAPE  CMDS 

EVENT  MESSAGE 
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.EVENT  PRIORITY:  non-critical  DATE/TIME  STAMP:  08-20-97  18:32:13 

.EVENT  SEQ.  NUMBER:  415  EVENT  TYPE:  10_ _ CSC _ ID:  2.01 

_ . of . the . signal  on  the  CTS  interface  has  changed. 

.• . . . comm . status:  enabled-  failed  CR6 

.  08-20-97  18:33:01  .  Events:  1  .  Responses:  0  .  ESCAPE  CMDS 

. . .  DISPLAY  NEXT  EVENT  MESSAGE 

.EVENT  PRIORITY:  non-critical  DATE/TIME  STAMP:  08-20-97  18:32:57 

.EVENT  SEQ.  NUMBER:  416  EVENT TYPE:  10  CSC  ID:  2.01 

.  Status _ of  the _ signal _ on _ the _ CTS _ interf a ce  has _ changed. 


comm  status:  enabled-active 


CR7 


EVENT  SEQ.  NUMBER:  369  EVENT  TYPE:  8  CSC  ID:  2.01 

An  error  has  occurred  on  the  CTS  interface. 


. comm  status:  invalid  CTS  msg  recvd 

EVENT  PRIORITY:  non-critical  DATE/TIME  STAMP:  08-20-97  18:28:12 
EVENT  SEQ.  NUMBER:  386  EVENT  TYPE:  10  CSC  ID:  2.01 

.?.t.3t.y.2...9f  the  signal  on  the  CTS  interface  has  changed. 

comm  status:  enabled-failed 


EVENT  PRIORITY:  non-critical  DATE/TIME  STAMP:  08-20-97  18:28:55 

EVENT  SEQ.  NUMBER:  387  EVENT  TYPE:  10 _ CSC  ID:  2.01 

Status  of  the  signal  on  the  CTS  interface  has  changed. 

comm  status:  enabled-active 


EVENT  PRIORITY:  non-critical  DATE/TIME  STAMP:  08-20-97  18:30:13 
EVENT  SEQ.  NUMBER:  401  EVENT  TYPE:  10  CSC  ID:  2.01 

.?h-^hys  of  the  signa^  on  the  CTS  interface  has  changed. 

comm  status:  enabled-failed 


EVENT  PRIORITY:  non-critical  DATE/TIME  STAMP':  08-20-97  18:30:57 
EVENT  SEQ.  NUMBER:  402  EVENT  TYPE:  10  CSC  ID;  2.01 

Status  of  the  signal  on  the  CTS  interface  has  changed . 

comm  status:  enabled-active 


EVENT  PRIORITY:  non-critical  DATE/TIME  STAMP:  08-20-97  18:32:13 
EVENT  SEQ.  NUMBER:  415  EVENT  TYPE:  10  CSC  ID:  2.01 

.  of  the  signal  on  the  CTS  interface  has  changed. 

. C-174 . 


CR8 


QR 1  7 
|CR9 


QR18 


dR10 


dRll 


dR12 


comm  status:  enabled-failed . . . . . . . . 

EVENT  PRIORITY:  non-critical  DATE/TIME  STAMP:  08-20-97  18:32:57 

EVENT  SEQ.  NUMBER:  416  EVENT  TYPE:  10 . CSC  ID:  2.01 

Status  of  the  signal  on  the  CTS  interface  has  changed. 

comm  status:  enabled-active  . . . . . . . . 


Jr13 


QR14 
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C.2.12.  TEST  DE-16  -  Recoverable  I/O  Errors 

The  following  paragraphs  provide  information  about  data  associated  with  this 
test  but  not  included  within  the  main  body  of  this  report. 


C.2.12.1.  Associated  Evaluation  Criteria  and  Data 

The  following  Evaluation  Criteria  were  used  to  determine  the  requirements 
passed/f ailed .  The  Cross  Reference  (CR)  numbers  can  be  used  to  trace  into  the 
data  found/referenced  below. 

Pass  Fail 

a*  [XX]  [  ]  Each  procedure  step's  "pass"  box,  in  the  'Observed  Results' 

column,  was  marked,  indicating  the  'Expected  Response'  was 
observed.  (See  Appendix  C  for  the  test  procedure  performed 
for  test  DE-16 . ) 

b.  Each  simulator  disable/enable  must  have  an  associated  event  in  the  ADAS 


Event 

log 

and  ADAS  must 

continue 

operation . 

Failed 

Active 

[XX] 

[ 

] 

AWOS-K001 

[CR5] 

[  CR6] 

[XX] 

[ 

] 

CTS  , 

[CR9] 

[CR10] 

[XX] 

[ 

] 

DLP 

[  CR1  ] 

[  CR2  ] 

[XX] 

[ 

] 

MPS 

[CR7  ] 

[  CR8  ] 

[XX] 

[ 

] 

WARP 

[  CR3  ] 

[CR4  ] 

[XX] 

[ 

] 

WMSCR 

[CR11] 

[CR12] 

[XX] 

[ 

] 

ITWS  1 

[CR13] 

[ CR14 ] 

[XX] 

[ 

] 

ITWS  2 

[CR15] 

[CR16] 

[XX] 

[ 

] 

ITWS  3 

[CR17 ] 

[CR18] 

[XX] 

[ 

] 

ITWS  4 

[CR19] 

[CR20] 

[XX] 

[ 

] 

ITWS  5 

[CR21] 

[CR22] 

[XX] 

[ 

] 

ITWS  6 

[CR23] 

[CR24 ] 

Continued  operation  of  ADAS  was  proven  by  the  ability  to  retrieve  the  ADAS 
Event  log  data  after  communications  of  the  12  simulators  identified  had  been 
disabled  for  60  seconds,  then  re-enabled. 

The  following  data  marked  with  evaluation  criteria  cross-reference  numbers  is 
a  subset  of  the  relevant  OT&E  formal  test  run  data  that  has  been  included  into 
DE-16 's  Test  Conduct  Form  (TCF)  file,  "DE-16. TCF", 
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EVENT  PRIORITY:  non-critical  DATE/TIME  STAMP:  08-20-97  19:31:16 

EVENT  SEQ.  NUMBER:  267  EVENT  TYPE:  1 . . CSC  ID:  4.05 

Status  of  the  DLP  connection  has  changed. 

comm  status:  enabled-f ailed  . . . . . . . 

EVENT  PRIORITY:  non-critical  DATE/TIME  STAMP:  08-20-97  19:32:16 

EVENT  SEQ.  NUMBER:  279  EVENT  TYPE:  1 . CSC  ID:  4.05 

Status  of  the  DLP  connection  has  changed. 

comm  status:  enabled- active _ _ _ _ _ 


EVENT  PRIORITY:  non-critical  DATE/TIME  STAMP:  08-20-97  19:32:15 

EVENT  SEQ.  NUMBER:  278  EVENT  TYPE:  2 _ CSC  ID:  4.01 

Status  of  the  WARP  connection  has  changed. 


comm  status:  enabled-f  ailed . . . . . . . 

EVENT  PRIORITY:  non-critical  DATE/TIME  STAMP:  08-20-97  19:33:28 

EVENT  SEQ.  NUMBER:  291  EVENT  TYPE?  2 . CSC  ID:  4.01 

Status  of  the  WARP  connection  has  changed. 

comm  status :  enabled-active  _ _ _ _ _ 


EVENT  PRIORITY:  non-critical  DATE/TIME  STAMP:  08-20-97  19:29:12 

EVENT  SEQ.  NUMBER:  243  EVENT  TYPE:  5 . CSC  ID:  3.02 

Status  of  the  AWOS  connection  has  changed. 

AWOS  station  id:  K001 controller:  1 

channel :  1 


Link  Status:  link  down  Event:  .link .  down 


EVENT  PRIORITY:  non-critical  DATE/TIME  STAMP:  08-20-97  19:30:12 

EVENT  SEQ.  NUMBER:  254  EVENT  TYPE:  . 5 .  . CSC  ID:  3.02 

Status  of  the  AWOS  connection  has  changed. 

AWOS  station  id:  K001 controller:  1 

channel :  1 


Link  Status :  up  Event:  link  reset 


EVENT  PRIORITY:  non-critical  DATE/TIME  STAMP:  08-20-97  19:35:15 

EVENT  SEQ.  NUMBER:  324  EVENT  TYPE:  7 . 

Status  of  the  MPS  connection  has  changed. 

comm  status:  enabled-f  ailed _ _ _ 


EVENT  PRIORITY:  non-critical  DATE/TIME  STAMP:  08-20-97  19:36:28 

EVENT  SEQ.  NUMBER:  34  6  EVENT  TYPE:  7 _ CSC  ID:  6.01 

Status  of  the  MPS_  connection has _.cha_nged_._ 


comm  status:  enabled-active 

. C- 179 


EVENT  PRIORITY:  non-critical  DATE/TIME  STAMP:  08-20-97  19:30:29 
EVENT  SEQ.  NUMBER:  255  EVENT  TYPE:  10  CSC  ID:  2.01 

Status  of  the  signal  on  the  CTS "inter face  ' has"' changed'-. 

. comm  status:  enabled-failed 


EVENT  PRIORITY:  non-critical  DATE/TIME  STAMP:  08-20-97  19:31:13 
EVENT  SEQ.  NUMBER:  266  EVENT  TYPE:  10  CSC  ID:  2.01 

the  CTS  interface  has  changed. 

comm  status :  enabled-active 


EVENT  PRIORITY:  non-critical  DATE/TIME  STAMP:  08-20-97  19:33:15 

EVENT  SEQ.  NUMBER:  290  EVENT  TYPE:  12 _ CSC  ID:  5.01 

Status  of  the  WMSCR  connection  has  changed. 

. comm  status:  enabled-failed 


EVENT  PRIORITY:  non-critical  DATE/TIME  STAMP:  08-20-97  19:34:27 
EVENT  SEQ.  NUMBER:  305  EVENT  TYPE:  12  CSC  ID:  5.01 

the  WMSCR  connection  has  changed. 

•  r 

comm  status:  enabled-active 


EVENT  PRIORITY:  non-critical  DATE/TIME  STAMP:  08-20-97  19:34:16 
EVENT  SEQ.  NUMBER:  302  EVENT  TYPE:  61  CSC  ID:  21.01 

Status  of  the  ITWS  connection  has  changed . 

site  id :  1001 

comm  status:  enabled-failed 


EVENT  PRIORITY:  non-critical  DATE/TIME  STAMP:  08-20-97  19:34:21 
EVENT  SEQ.  NUMBER:  303  EVENT  TYPE :  61  CSC  ID:  21.01 

Status  of  the  ITWS  connection  has  changed. 

site  id:  1002 

comm  status:  enabled-failed 


EVENT  PRIORITY:  non-critical  DATE/TIME  STAMP:  08-20-97  19:34:25 
EVENT  SEQ.  NUMBER:  304  EVENT  TYPE:  61  CSC  ID:  21.01 

.? t ® t.\i s. . .9. t . . . the  ITWS  connection  has  changed. 

site  id:  1003 

comm  status:  enabled-failed 


EVENT  PRIORITY:  non-critical  DATE/TIME  STAMP:  08-20-97  19:34:28 
EVENT  SEQ.  NUMBER:  306  EVENT  TYPE:  61  CSC  ID:  21.01 

connection  has  changed. 

site  id:  1006 

comm  status:  enabled-failed 


EVENT  PRIORITY:  non-critical  DATE/TIME  STAMP:  08-20-97  19:34:31 

EVENT  SEQ.  NUMBER:  307  EVENT  TYPE:  61 _ CSC  ID:  21.01 

Status  of  the  ITWS  connection  has  changed. 

site  id:  1004 
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comm  status:  enabled-f ailed .  . . . 

EVENT  PRIORITY:  non-critical  DATE/TIME  STAMP:  08-20-97  19:34:35 

EVENT  SEQ.  NUMBER:  308  EVENT  TYPE:  61 _ CSC  ID:  21.01 

Status  of  the  ITWS  connectionhas  changed. 

_ site  id: _ 1005 

comm  status:  enabled-failed  ' _ _ _ _ _ _ 


EVENT  PRIORITY:  non-critical  DATE/TIME  STAMP:  08-20-97  19:35:16 

EVENT  SEQ.  NUMBER:  325  EVENT  TYPE:  61  _ _ CSC  ID:  21.01 

Status  of  the  ITWS  connection  has  changed. 


site  id:  1004 

comm  status:  enabled- active 


EVENT  PRIORITY:  non-critical  DATE/TIME  STAMP:  08-20-97  19:35:16 

EVENT  SEQ.  NUMBER:  326  EVENT  TYPE:  61 . CSC  ID:  21.01 

Status  of  the  ITWS  connection  has  changed. 

site  id:  1001 

comm  status:  enabled-active  . ; . . 

EVENT  PRIORITY:  non-critical  DATE/TIME  STAMP:  08-20-97  19:35:19 

EVENT  SEQ.  NUMBER:  327  EVENT  TYPE:  61 . CSC  ID:  21.01 

Status  of  the  ITWS  connection__has__changed_._ 

site  id:  1005 

comm  status :  enabled-active  ; . . . . 

EVENT  PRIORITY:  non-critical  DATE/TIME  STAMP:  08-20-97  19:35:19 

EVENT  SEQ.  NUMBER:  328  EVENT  TYPE:  61 . CSC  ID:  21.01 

Status  of  the  ITWS  connection  has  changed. 

_ s^ite  id:  1002 

comm  status:  enabled-active _ _ _ _ _ _ 


EVENT  PRIORITY:  non-critical  DATE/TIME  STAMP:  08-20-97  19:35:23 

EVENT  SEQ.  NUMBER:  329  EVENT  TYPE:  61 _ CSC  ID:  21.01 

Status  of  the  ITWS  connection^has^jchanged^ 

site  id:  1003 

comm  status:  enabled-active  . . . . . . _ 


EVENT  PRIORITY:  non-critical  DATE/TIME  STAMP:  08-20-97  19:35:26 

EVENT  SEQ.  NUMBER:  330  EVENT  TYPE:  61  . CSC  ID:  21.01 

Status  of  the  ITWS  connection  has  changed. 

site  id:  1006 

comm  status:  enabled-active  . . . . . 
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C.2.13.  TEST  DE-18  -  Recoverable  I/O  Init.  Error  (NLDN) 

The  following  paragraphs  provide  information  about  data  associated  with  this 
test  but  not  included  within  the  main  body  of  this  report. 


C.2.13.1.  Associated  Evaluation  Criteria  and  Data 

The  following  Evaluation  Criteria  were  used  to  determine  the  requirements 
passed/f ailed .  The  Cross  Reference  (CR)  numbers  can  be  used  to  trace  into  the 
data  f ound/referenced  below. 

Pass  Fail 

a-  [XX]  t  ]  Each  procedure  step's  "pass"  box,  in  the  'Observed  Results' 

column,  was  marked,  indicating  the  'Expected  Response'  was 
observed.  (See  Appendix  C  for  the  test  procedure  performed 
for  test  DE-18.) 

b-  [XX]  t  ]  The  ADAS  Event  Log  must  show  that  ADAS  detected  the  off-line 

NLDN  Simulator  CR1  and  continued  to  the  Operational  State  -  | 
Reduce  Mode  as  indicated  by  the  SYS_MODE  datapoint  (LU  20  DP 
02)  in  the  Datapoint  request  CR2*.  | 

b-  [XX]  [  ]  After  communication  was  restored,  the  NLDN  simulator  must  be 

reported  as  active  CR3 .  I 


[XX]  [  ]  The  transition  from  Reduce  to  Full  Mode  must  have  occurred 

as  indicated  by  the  third  request  of  the  SYS  MODE  datapoint 
(LU20  DP02 )  CR4 


The  time  stamps  shown  on  the  datapoint  messages  indicates  when  it  was 
retrieved  and  not  when  the  datapoint  changed  value. 


The  following  data,  marked  with  evaluation  criteria  cross-reference  numbers, 
is  a  subset  of  the  OT&E  formal  test  run  data.  Other  relavent  data  has  been 
included  into  DE-18 's  Test  Conduct  Form  (TCF)  file,  "DE-18. TCF". 

EVENT  PRIORITY:  non-critical  DATE/TIME  STAMP:  08-20-97  20:19:18 

EVENT  SEQ.  NUMBER:  63  EVENT  TYPE:  62 . CSC  I D :  2 2 i 0 2 . 

Status  of  the  NLDN  connection  has  changed. 

. comm  status:  enabled- failed 


EVENT  PRIORITY:  non-critical  DATE/TIME  STAMP:  08-20-97  20:21:32 
EVENT  SEQ.  NUMBER:  252 EVENT  TYPE :  62  CSC  ID:  22.01 

NLDN  connection  has  changed. 

_ comm  status:  enabled-active 


INPUT  MESSAGE  #:  158 

RECEIVE  TIME  (ADAS):  08/20/97  20:21:15 
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+++++J 

21378 

RMS  ID: 

0x01 

LOGICAL  UNIT  ID: 

0x20 

21380 

DATE: 

08/20/97 

TIME : 

20:21:16 

21382 

DATAPOINT  ID: 

0x02 

CONDITION  STATUS: 

0x42 

21384 

PARAMETER  VALUE 

:  (001)  Decimal 

INPUT 

MESSAGE  #: 

159 

RECEIVE  TIME  (ADAS) : 

08/20/97  20:22 

X  X  X  4. 4-  4. 4-  4— »-  4-  4-  4-  4*  4-  4-  + 

:  36 

TTTTT" 

21398 

RMS  ID: 

0x01 

LOGICAL  UNIT  ID: 

0x20 

21400 

DATE: 

08/20/97 

TIME: 

20:22:36 

21402 

DATAPOINT  ID: 

0x02 

CONDITION  STATUS: 

0x40 

21404  PARAMETER  VALUE:  (000)  Decimal 
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@ASC:  "si  [RTN]  testl2  [RTN]  [F13]  [Fll]  The  ASC  displays  the  'login'  prompt. 

<7 :  [RTN] >  62  [RTN]  [wait]  <3:[F14]>  [SP]  The  event  is  removed  from  the  ISI. 
[RTN] " 

@ISC :  " [F7] " 
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C.3.  CATEGORY  DTE  -  Developmental  Test  &  Evaluation  Tests 

The  test  results  of  the  ADAS/ALDARS  OT&E  Formal  Test  Runs  of  the  ALDARS  DT6E 
Tests  were  identical  to  the  '  test  results  during  the  DT&E  Formal  Test  Runs. 
The  DT&E  test "  details  have  been  documented  in  the  ADAS/ALDARS  Contractor's 
DT&E  Test  Plan,  Test  Procedures,  and  Test  Report  documents.  For  further 
information  about  category  DTE  tests,  refer  to  the  contractor's  DT&E  test 
documentation . 


C.4.  CATEGORY  IN  -  Integration  Tests 


C.4.1.  TEST  IN-01  -  Channel  Connection  Test  FST  (MPS) 

The  following  paragraphs  provide  information  about  data  associated  with  this 
test  but  not  included  within  the  main  body  of  this  report. 


C.4.1. 1.  Associated  Evaluation  Criteria  and  Data 


The  following  Evaluation  Criteria  were  used  to  determine  the  requirements 
passed/failed.  The  Cross  Reference  (CR)  numbers  can  be  used  to  trace  into  the 
data  found/referenced  below. 


Pass  Fail 

[XX]  t  ]  Each  procedure  step's  "pass"  box,  in  the  'Observed  Results' 
column,  was  marked,  indicating  the  'Expected  Response'  was 
observed.  (See  Appendix  C  for  the  test  procedure  performed 
for  test  IN-01 . ) 

[XX]  [  ]  The  retrieved  ADAS  Event  Log  must  show  that  ADAS 

successfully  detected  the  loss  of  connection  CR1  with  the 
MPS  simulator  and  the  subsequent  re-connection  CR2 . 


The  following  data,  marked  with  evaluation  criteria  cross-reference  numbers, 
is  a  subset  of  the  OT&E  formal  test  run  data.  Other  relavent  data  has  been 
included  into  IN-01 's  Test  Conduct  Form  (TCF)  file,  "IN-01. TCF". 

EVENT  PRIORITY:  non-critical  DATE/TIME  STAMP:  08-18-97  14:36:06 

EVENT  SEQ.  NUMBER:""254 . EVENf''TYPE':''''7  ~CSC"TD;""67or. . 

Status  of  the  MPS  connection  has  changed. 

comm  status:  enabled-failed 


EVENT  PRIORITY:  non-critical  DATE/TIME  STAMP:  08-18-97  14:36:37 
EVENT  SEQ.  NUMBER:  260  EVENT  TYPE:  7  CSC  ID:  6.01 

connection  has  changed. 
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CR1 


comm  status:  enabled-active 


INPUT  MESSAGE  #:  1 


RECEIVE  TIME  (IPS) : 

08/18/97 

14:37 

:  07 

RECEIVE  TIME  (ADAS ) 

:  08/18/97 

14:37 

:  07 

MESSAGE  TYPE:  MPS  Return  to  Normal 

RMS  ID: 

0x01 

LOGICAL  UNIT  ID: 

0x23 

DELIMITER: 

0x00 

MESSAGE  FUNCTION: 

42 

DATE: 

08/18/97 

TIME: 

14:37: 05 

DATAPOINT  ID: 

0x01 

CONDITION  STATUS: 

0x40 

DATA  TYPE: 

0x01 

RESOLUTION: 

0x00 

PARAMETER  VALUE : . (  ”0 02  ) Decimal 
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12.  Output  the  I  ML:  MPS  RETURN  TO  NORMAL  to  file.  [X]  Pass  [  ]  Fail  Stop  Test 

@ISC:  "  [F7]  IN-01  <2:[RTN]>  [SP]  [RTN]  M  The  output  file  is  in  directory  '/trap'. 

<3: [DOWN] >  <2:[RTN]>  {wait}  <3: [F14]>"  The  ISI  default  screen  is  displayed. 


C.4.2.  TEST  IN-02  -  Channel  Connection  Test  FST  (AWOS) 

The  following  paragraphs  provide  information  about  data  associated  with  this 
test  but  not  included  within  the  main  body  of  this  report. 


C.4.2.1.  Associated  Evaluation  Criteria  and  Data 

The  following  Evaluation  Criteria  were  used  to  determine  the  requirements 
passed/f ailed .  The  Cross  Reference  (CR)  numbers  can  be  used  to  trace  into  the 
data  found/referenced  below. 

Pass  Fail 

a.  [XX]  [  ]  Each  procedure  step’s  "pass"  box,  in  the  'Observed  Results' 

column,  was  marked,  indicating  the  'Expected  Response'  was 
observed.  (See  Appendix  C  for  the  test  procedure  performed 
for  test  IN-02 . ) 

k-  [XX]  [  ]  The  retrieved  '■  ADAS  Event  Log  must  show  that  ADAS 

successfully  detected  the  loss  of  connection  CR1  with  the 
AWOS  simulator  and  the  subsequent  re-connection  CR2 . 


The  following  data,  marked  with  evaluation  criteria  cross-reference  numbers, 
is  a  subset  of  the  OT&E  formal  test  run  data.  Other  relavent  data  has  been 
included  into  IN-02 's  Test  Conduct  Form  (TCF)  file,  "IN-02. TCF". 

EVENT  PRIORITY:  non-critical  DATE/TIME  STAMP:  08-18-97  14:57:02 

EVENT  SEQ,  NUMBER:  258 .  EVENT  TYPE:"  5  ~  CSC'  lD:  3 . 02 “ 

the  AWOS  connection  has  changed. 

AWOS  station  id:  K001  controller:  1 
channel :  1 

. LinkStatus:l ink  down  Event:  link  down 

EVENT  PRIORITY:  non-critical  DATE/TIME  STAMP:  08-18-97  14:57:31 

EVENT  SEQ.  NUMBER:  267 . ~~EVENT~TYPE :  "5  ~  ~CSC  ID:'"  3. 02  ’  “ 

?.£.®tus  of  the  AWOS  connection  has  changed. 

AWOS  station  id:  K001  controller:  1 
channel :  1 

. Link  Status:  up  Even t:  link  reset 

INPUT  MESSAGE  #:  1 


RECEIVE  TIME  (IPS):  08/18/97  14:57:07 

RECEIVE  TIME  (ADAS):  08/18/97  14:57:07 


SIMULATOR  ID: 

3 

MESSAGE  TYPE: 

MPS 

ALARM 

MESSAGE  SIZE: 

21 

GROUP  ID: 

0 

MESSAGE  TYPE: 

MPS  Alarm 

RMS  ID: 

0x01 

LOGICAL  UNIT  ID: 

0x41 

CR1 


CR2 
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DELIMITER: 

0x00 

MESSAGE  FUNCTION: 

41 

DATE: 

08/18/97 

TIME: 

14:57: 05 

DATAPOINT  ID: 

0x01 

CONDITION  STATUS: 

0x42 

DATA  TYPE: 

0x01 

RESOLUTION: 

0x00 

PARAMETER  VALUE: 

(001)  Decimal 

INPUT  MESSAGE  # 

RECEIVE  TIME 

(IPS)  : 

(01)  Hex 
(  )  Ascii 

1 

08/18/97  14: 

58:07 

RECEIVE  TIME 

(ADAS) 

:  08/18/97  14: 

58:07 

SIMULATOR  ID: 
MESSAGE  TYPE: 
MESSAGE  SIZE: 
GROUP  ID: 

3 

MPS  RTN  NORMAL 

21 

0 

MESSAGE  TYPE: 

MPS  Return  to  Normal 

0x41 

RMS  ID: 

0x01 

LOGICAL  UNIT  ID: 

DELIMITER: 

0x00 

MESSAGE  FUNCTION: 

42 

DATE: 

08/18/97 

TIME: 

14:58:05 

DATAPOINT  ID: 

0x01 

CONDITION  STATUS: 

0x40 

DATA  TYPE: 

0x01 

RESOLUTION: 

0x00 

PARAMETE R  VALUE : (002)  Decimal 


(02)  Hex 
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C.4.3.  TEST  IN-03  -  Channel  Connection  Test  FST  (DLP) 

The  following  paragraphs  provide  information  about  data  associated  with  this 
test  but  not  included  within  the  main  body  of  this  report. 

C.4.3.1.  Associated  Evaluation  Criteria  and  Data 


The  following  Evaluation  Criteria  were  used  to  determine  the  requirements 
passed/failed.  The  Cross  Reference  ( CR)  numbers  can  be  used  to  trace  into  the 
data  found/referenced  below. 


a . 


b. 


Pass  Fail 

[XX]  [  ]  Each  procedure  step’s  "pass"  box,  in  the  'Observed  Results' 

column,  was  marked,  indicating  the  'Expected  Response'  was 
observed.  (See  Appendix  C  for  the  test  procedure  performed 
for  test  IN-03 . ) 

[XX]  [  ]  The  retrieved  ADAS  Event  Log  must  show  that  ADAS 

successfully  detected  the  loss  of  connection  CR1  with  the 
DLP  simulator  and  the  subsequent  re-connection  CR2 . 


The  following  data,  marked  with  evaluation  criteria  cross-reference  numbers, 
is  a  subset  of  the  OT&E  formal  test  run  data.  Other  relavent  data  has  been 
included  into  IN-03 's  Test  Conduct  Form  (TCF)  file,  "IN-03. TCF". 


EVENT  PRIORITY;  non-critical  DATE/TIME  STAMP:  08-18-97  15:12:05 

EVENT  SEQ .  NUMBER i  264 . E^f  jTYPEr'l CSC  ID;  4 .05  . 

Status  of  the  DLP  connection  has  changed. 


comm  status: 


enabled- failed 


iCRl 


EVENT  PRIORITY:  non-critical  DATE/TIME  STAMP:  08-18-97  15:12:36 

EVENT  SEQ.  NUMBER:  273 .  EVENT'  TYPE '  1  "cSC"l~D:'  4 . 05 

DhP  connection  has  changed. 

comm  status :  enabled-active 


INPUT  MESSAGE  #:  1 


RECEIVE  TIME  (IPS) : 
RECEIVE  TIME  (ADAS) 
SIMULATOR  ID: 
MESSAGE  TYPE: 
MESSAGE  SIZE: 

GROUP  ID: 

MESSAGE  TYPE 
RMS  ID: 

DELIMITER: 


08/18/97  15: 
08/18/97  15: 
3 

MPS_ALARM 

21 


MPS  Alarm 

0x01 

0x00 


12: 

12: 


08 

08 


DATE: 


08/18/97 


LOGICAL  UNIT  ID: 
MESSAGE  "iTONCTIONT 


TIME: 


0x29 

. 41 . 

15:12:06 


C-196 


DATAPOINT  ID: 

0x01 

CONDITION  STATUS : 

0x42 

DATA  TYPE: 

0x01 

(00i)  Dpnimal 

RESOLUTION: 

0x00 

PAHAMhlriK  V/iijUij. 

INPUT  MESSAGE  #: 

RECEIVE  TIME  (IPS) 
RECEIVE  TIME  (ADAS 
SIMULATOR  ID: 
MESSAGE  TYPE: 
MESSAGE  SIZE: 

GROUP  ID: 

MESSAGE  TYPE:  MPS 
RMS  ID: 

DELIMITER: 

(01)  Hex 
(  )  Ascii 

1 

:  08/18/97  15:13 

) :  08/18/97  15:13 

3 

MPS  RTN  NORMAL 
21 

0 

Return  to  Normal 
0x01 

0x00 

:  07 
:  07 

LOGICAL  UNIT  ID: 
MESSAGE  FUNCTION: 

0x29 

42 

DATE: 

08/18/97 

TIME: 

15:13:05 

DATAPOINT  ID: 

0x01 

CONDITION  STATUS: 

0x40 

DATA  TYPE: 

0x01 

RESOLUTION: 

0x00 

PARAMETER  VALUE: 

(002)  Decimal 

(02)  Hex 

(  )  Ascii 


ICR1 


CR2 
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C.4.4.  TEST  IN-04  -  Channel  Connection  Test  FST  (WARP) 

The  following  paragraphs  provide  information  about  data  associated  with  this 
test  but  not  included  within  the  main  body  of  this  report. 


C.4.4.1.  Associated  Evaluation  Criteria  and  Data 

The  following  Evaluation  Criteria  were  used  to  determine  the  requirements 
passed/failed.  The  Cross  Reference  (CR)  numbers  can  be  used  to  trace  into  the 
data  found/referenced  below. 

Pass  Fail 

a-  [XX]  [  ]  Each  procedure  step's  "pass"  box,  in  the  'Observed  Results' 

column,  was  marked,  indicating  the  'Expected  Response'  was 
observed.  (See  Appendix  C  for  the  test  procedure  performed 
for  test  IN-04 . ) 

[XX]  [  ]  The  retrieved  ADAS  Event  Log  must  show  that  ADAS 
successfully  detected  the  loss  of  connection  CR1  with  the 
WARP  simulator  and  the  subsequent  re-connection  CR2. 


The  following  data,  marked  with  evaluation  criteria  cross-reference  numbers, 
is  a  subset  of  the  OT&E  formal  test  run  data.  Other  relavent  data  has  been 
included  into  IN-04 's  Test  Conduct  Form  (TCF)  file,  "IN-04. TCF”. 

EVENT  PRIORITY:  non-critical  DATE/TIME  STAMP:  08-18-97  15:26:05 

EVENT  SEQ.  NUMBER:  251 . EVENT  TYPE:  2  CSC  ID:  4.01 

.?.^.™ty.®....9.?....^.®.^ARP  connection  has  changed. 

comm  status:  enabled-f ailed 


.?y5.NT..PRIORITYjm_n_on-critical  DATE/TIME  STAMP:  08-18-97  15:26:36 

EVENT  SEQ.  NUMBER:  266"'3ZEVENT7rYPE:''^ . CSC'i'dTT.' Ol' . . . 

Status  of  the  WARP  connection  has  changed. 

. comm  status:  enab led-active 

INPUT  MESSAGE  #:  1 


RECEIVE  TIME  (IPS) : 
RECEIVE  TIME  (ADAS) : 
SIMULATOR  ID: 

MESSAGE  TYPE: 

MESSAGE  SIZE: 

GROUP  ID: 

MESSAGE  TYPE:  MPS  Alarm 
RMS  ID:  Ox 

DELIMITER:  Ox 


DATE 


DATAPOINT  ID 


08/18/97  15:26:08 
08/18/97  15:26:08 
3 

MPS_ALARM 

21 


0x01  LOGICAL  UNIT  ID:  0x2a 

. 0x00  MESSAGE" "FUNCTION:’ . 41 


08/18/97 _  TIME:  . '15726:05 


0x01  _ CONDITION  STATUS:  0x42 


DATA  TYPE:  . . 

PARAMETER  VALU  E : 


0x01  RESOLUTION : . 0x00 

(661)  Decimal . . . . 

(01  j"' Hex . 

(  )  Ascii 


INPUT  MESSAGE  #:  1 


RECEIVE  TIME 
RECEIVE  TIME 

(IPS)  : 
(ADAS ) 

08/18/97  15:27:07 
:  08/18/97  15:27:07 

SIMULATOR  ID: 
MESSAGE  TYPE: 

MPS_ 

3 

RTN  NORMAL 

MESSAGE  SIZE: 

21 

GROUP  ID: 
MESSAGE  TYPE: 
RMS  ID: 
DELIMITER: 

MPS  Return  to 
0x01 

0 

Normal 

LOGICAL  UNIT  ID: 

0x2a 

0x00 

MESSAGE  FUNCTION: 

42 

DATE: 

08/18/97 

TIME: 

15:27:04 

DATAPOINT  ID: 

0x01 

CONDITION  STATUS: 

0x40 

DATA  TYPE: 

PARAMETER  VALUE: 

0x01 

(002) 

RESOLUTION: 

Decimal 

0x00 

(02)  Hex 


C.4.4.2.  TCF  Test  Procedure  Steps 

The  following  test  procedure  steps,  ref 
paragraph  in  the  main  body  of  this  repo 
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C.4.5.  TEST  IN-05  -  Channel  Connection  Test  FST  (WMSCR) 

The  following  paragraphs  provide  information  about  data  associated  with  this 
test  but  not  included  within  the  main  body  of  this  report. 


C.4.5.1.  Associated  Evaluation  Criteria  and  Data 

The  following  Evaluation  Criteria  were  used  to  determine  the  requirements 
passed/failed.  The  Cross  Reference  (CR)  numbers  can  be  used  to  trace  into  the 
data  found/referenced  below. 

Pass  Fail 

a*  [XX]  [  ]  Each  procedure  step's  "pass"  box,  in  the  'Observed  Results' 

column,  was  marked,  indicating  the  'Expected  Response'  was 
observed.  (See  Appendix  C  for  the  test  procedure  performed 
for  test  IN-05 . ) 

[XK]  [  ]  The  retrieved ADAS  Event  Log  must  show  that  ADAS 
successfully  detected  the  loss  of  connection  CR1  with  the 
WMSCR  simulator  and  the  subsequent  re-connection  CR2. 


The  following  data,  marked  with  evaluation  criteria  cross-reference  numbers, 
is  a  subset  of  the  OT&E  formal  test  run  data.  Other  relavent  data  has  been 
included  into  IN-05 's  Test  Conduct  Form  (TCF)  file,  "IN-05. TCF" . 

EVENT  PRIORITY:  non-critical  DATE/TIME  STAMP:  08-18-97  15:38:05 
NUMBER: ....258  EVENT  TYPE :  12  CSC  ID:  5.01 

connection  has  changed. 

_ comm  status:  enabled-failed 


EVENT  PRIORITY:  non-critical  DATE/TIME  STAMP:  08-18-97  15:38:36 

EVENT  SEQ.  NUMBER:  267 _ "EVENT "TYPE:""' 12 . . CSC"”i'D ;""5"."01 . . . " 

Status  of  the  WMSCR  connection  has  changed. 

comm  status:  enabled-active 


INPUT  MESSAGE  #: 


RECEIVE  TIME  (IPS) : 
RECEIVE  TIME  (ADAS): 
SIMULATOR  ID: 

MESSAGE  TYPE: 

MESSAGE  SIZE: 

GROUP  ID: 

MESSAGE  TYPE:  MPS  Alarm 
RMS  ID:  0x01 


08/18/97  15:38:08 
08/18/97  15:38:08 
3 

MPS_ALARM 

21 

0 


LOGICAL  UNIT  ID: 


0x2b 


DATE : 

08/18/97 

TIME : 

15:38:06 

DATAPOINT  ID: 

0x01 

CONDITION  STATUS: 

0x42 
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DATA  TYPE:  0x01  . . 

. PARAMETE R  VALUE : . (661)  Decimal  . 

. (01)  Hex 

(  )  Ascii 

INPUT  MESSAGE  #:  1 

RECEIVE  TIME  (IPS):  08/18/97  15:39:08 

RECEIVE  TIME  (ADAS):  08/18/97  15:39:08 

SIMULATOR  ID:  3 

MESSAGE  TYPE:  MPS_RTN_NORMAL 


MESSAGE  SIZE: 
GROUP  ID: 

MESSAGE  TYPE:  MPS 
RMS  ID: 

DELIMITER: 

Return  to 
0x01 
0x00 

21 

0 

Normal 

LOGICAL  UNIT  ID: 
MESSAGE  FUNCTION: 

0x2b 

42 

DATE: 

08/18/97 

TIME: 

15:39:05 

DATAPOINT  ID: 

0x01 

CONDITION  STATUS: 

0x4  0 

DATA  TYPE: 

0x01 

RESOLUTION: 

6x00 

CR2 

PARAMETER  VALUE: 

(002) 

Decimal 

(02)  Hex 
(  )  Ascii 
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C.4.6.  TEST  IN-08  -  CTS  Processing 

The  following  paragraphs  provide  information  about  data  associated  with  this 
test  but  not  included  within  the  main  body  of  this  report. 


C.4.6.1.  Associated  Evaluation  Criteria  and  Data 

The  following  Evaluation  Criteria  were  used  to  determine  the  requirements 
passed/f ailed .  The  Cross  Reference  (CR)  numbers  can  be  used  to  trace  into  the 
data  found/referenced  below. 

Pass  Fail 

a.  [XX]  [  ]  Each  procedure  step's  "pass"  box,  in  the  'Observed  Results' 

column,  was  marked,  indicating  the  'Expected  Response'  was 
observed.  (See  Appendix  C  for  the  test  procedure  performed 
for  test  IN-08 . ) 

b.  [XX]  [  ]  The  event  generated  by  the  ADAS  adjustment  to  the  CTS  signal 

will  record  the  CTS  time  standard,  ADAS  system  time  before 
the  update,  and  the  time  stamp  of  the  event  will  show  the 
ADAS  system  time  after  the  adjustment.  Subtracting  the 
indicated  CTS  time  from  the  ADAS  system  time  stamp  will 
result  in  the  deviation  value  which  must  be  +/-  one  second 
or  less  on  the  average. 

CR  Reference  Difference 


CR1 

0 

CR2 

0 

CR3 

0 

CR4 

0 

CR5 

0 

CR6 

0 

CR7 

0 

CR8 

0 

CR9 

0 

CR10 

0 

CR11 

0 

CR12 

0 

Total  0 


Total  0  /  12  =  Average  _0 


The  following  data,  marked  with  evaluation  criteria  cross-reference  numbers, 
is  a  subset  of  the  OT&E  formal  test  run  data.  Other  relavent  data  has  been 
included  into  IN-08' s  Test  Conduct  Form  (TCF)  file,  "IN-08. TCF". 

EVENT  PRIORITY:  non-critical  DATE/TIME  STAMP:  08-18-97  17:16:15 
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EVENT  SEQ .  NUMBER:  4  5 . ..TYPE :  9 

ADAS  time  has  been  reset  by  CTO. 


CSC  ID:  2.01 


current  time:  08-18-97  17:16:13 

new  time:  08-18—97 . . . 

EVENT  PRIORITY:  non-critical  DATE/TIME  STAMP:  OizMzil-li :  — — 

EVENT  SEQ .  NUMBER:  251 _ EVENT  TYPE:  .9 _ CS C ..I D L_2_-_01 

ADAS  time  has  been  reset  by  CTM. 

current  time:  08-18-97 _ 17jJ 17j_16 

new  time:  08-18-97  18:05:14 - - - - - — — 

EVENT  PRIORITY:  non-critical  DATE/TIME  STAMP:  .08-18-97  18 .:  0.8  :14 

EVENT  SEQ.  NUMBER:  258  EVENT  TYPE:  9 _ CSC  ID: — 2 .01 

ADAS  time  has  been  reset  by  CTM. 


current  time:  08-18-97 

new  time:  08-18-97  18 : 08: 14 _ 


EVENT  PRIORITY:  non-critical  DATE/TIME  STAMP: 

EVENT  S EQ .  NUMBER :  265  EVENT  TYPE:  9 . ID :  01 

ADAS  time  hais  been  reset  by  CTM. 


current  time:  08— 18-97_...-._18.:.09_:  1.2 
new  time:  08-18-97  18:11:11 . 


EVENT  PRIORITY:  non-critical  DATE/TIME  STAMP:  08  18  97  18:14:12 

EVENT  S  EQ  .  NUMBER:  272  -  '  EVENT  TYPE:  9 . . . CSC.  ID  s  J2  ...01 

ADAStimehasbeen  reset  by  CTM. 


current  _time : _ 08 -18  “97 _ .1.8  slj2j.ll 

new  time:  08-18-97  18:14:12 . 


EVENT  PRIORITY:  non-critical  DATE/TIME  STAMP:  08-18-97  18jl7:10 

EVENT  SEQ.  NUMBER:  27  9  EVENT  TYPE:  9 _ CSC  ID:  2.01 

ADAS  time  has  been  reset  by  CTM. 


current  time;  08-18-97  18:15:11 

new  time:  08-18-97  18:17:10 . 


EVENT  PRIORITY:  non-critical  DATE/TIME  STAMP:  .0.£7.18-97...1S:20:12 

EVENT  SEQ .  NUMBER :  2 8  6  EVENT  TYPE:  9 _ CSC  ID:  2.01 

ADAS  time  has  been  reset  by  CTM. 


current  time:  08-18-97 

new  time:  68-18-97  18:20: 12 _ 


EVENT  PRIORITY:  non-critical  DATE/TIME  STAMP:  P.8“7.®“9718:23:11 

EVENT  SEQ .  NUMBER:  293 EVENT  TYPE:  9 . CSC  ID:  2.01 

ADAS  time  has  been  reset  by  CTM. 


current  time:  08-18-97  .18 : 21 : 12 
new  time:  08-18-97  18:23:11 


EVENT  PRIORITY:  non-critical  DATE/TIME  STAMP:  08-.18-..97...j.8:26 ;  13 

EVENT  SEQ.  NUMBER:  300  . EVENT  TYPE:  9 . CSC  ID:  2.01 

ADAS  ’time" has 'been  reset  by  CTM. 
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'CR9 


. current  time:  08- 18-97  18:24:12 

new  time:  08-18-97 . 18:26:13 . 

EVENT  PRIORITY:  non-critical  DATE/TIME  STAMP:  08-18-97  18:29:11 

EVENT  SEQ.  NUMBER:  307  EVENT  TYPE:  9  CSC  i'D:  '"2."0l' . . . 

ADAS  time  has  been  reset  by  CTM. 

. current  time:  08-18-97  18:27:12 

new  time:  08-18-97 . 18 : 29 :1 1 . . 

EVENT  PRIORITY:  non-critical  DATE/TIME  STAMP:  08-18-97  18:32:13 
EVENT  SEQ.  NUMBER:  314  EVENT  TYPE:  9  CSC  ID:  2.01 

ADAS  time  has  been  reset  by  CTM.  . . 

current  time:  08-18-97  18:30:12 

. new  timeT 08-18-9T  'l8:'32:13  Hrh 

EVENT  PRIORITY:  non-critical  DATE/TIME  STAMP:  08-18-97  18:35:11 
EVENT  SEQ.  NUMBER:  321  EVENT  TYPE:  9  CSC  ID:  2.01 

ADAS  time  has  been  reset  by  CTM. 

current  time:  08-18-97  18:33:12 

_ new  time:  08-18-97  18 : 35: 11  CR12 
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C.4.7.  TEST  IN-09  -  AWOS  Originated  Date/Time/Test  Messages 

The  following  paragraphs  provide  information  about  data  associated  with  this 
test  but  not  included  within  the  main  body  of  this  report. 


C.4.7.1.  Associated  Evaluation  Criteria  and  Data 

The  following  Evaluation  Criteria  were  used  to  determine  the  requirements 
passed/failed.  The  Cross  Reference  (CR)  numbers  can  be  used  to  trace  into  the 
data  found/ref erenced  below. 

Pass  Fail 


a.  [XX]  [  ] 


b.  [XX]  [  ] 


c.  [XX]  [  ] 


Each  procedure  step's  "pass"  box,  in  the  'Observed  Results' 
column,  was  marked,  indicating  the  'Expected  Response'  was 
observed.  (See  Appendix  C  for  the  test  procedure  performed 
for  test  IN-09  .  ) 

Each  request,  Test-CRl  Erroneous-CR2 ,  and  Date/Time-CR3,  as  J 
logged  in  the  IPS  Outbound  Message  index,  must  produce  the 
corresponding  response  message  in  the  IPS  Inbound  Message 
log,  CR4  CR5  &  CR6  respectively  I 

The  returned  time/date  response  must  indicate  a  time  and 
date  that  was  synchronized  with  the  IPS  test  time  as 
indicated  by  the  IPS  log  records  of  the  test  and  system 
times  compared  to  the  date/time  response  CR7 .  1 


Note  that  consideration  must  be  given  to  transfer  and  IPS  process 
time/boundaries.  This  will  typically  add  one  second. 


The  following  data,  marked  with  evaluation  criteria  cross-reference  numbers, 
is  a  subset  of  the  OT&E  formal  test  run  data.  Other  relavent  data  has  been 
included  into  IN-09 's  Test  Conduct  Form  (TCF)  file,  "IN-09. TCF". 

INPUT  MESSAGE  #:  1 

RECEIVE  TIME  (IPS):  08/18/97  17:40:14 

RECEIVE  TIME  (ADAS):  08/18/97  17:40:14 


SIMULATOR  ID: 

12 

MESSAGE  TYPE: 

AWOS  ERR  MSG 

MESSAGE  SIZE: 

16 

GROUP  ID: 

-1 

MESSAGE  TYPE:  Adas 

Error 

Message 

FORMAT  ID: 

2 

AWOS/ASOS  CONFIG 

NO:  0 

FORMAT  TYPE: 

2 

DATE: 

97/08/18 

LENGTH  INDICATOR: 

14 

TIME: 

17:40:00 

AWOS/ASOS  ID: 

ERROR  MESSAGE: 

K001 

ERROR  POSITION: 

0 

If  00 
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INPUT  MESSAGE  #: 


1 


RECEIVE  TIME  (IPS):  08/11 

RECEIVE  TIME  (ADAS) :  08/11 

SIMULATOR  ID: 

MESSAGE  TYPE:  AWOS 

MESSAGE  SIZE: 

GROUP  ID: 

MESSAGE  TYPE:  Date/Time  Adu 
FORMAT  ID:  0 

FORMAT  TYPE :  9 

LENGTH  INDICATOR:  13 

AWOS/ASOS  ID:  K001 

AWOS/ASOS  CONFIG  NO:  0 

DATE:  _ _ 08/18/97 

""TIME: . .  ~  . 17:39:4 2 


OFFSET:  UTC  TO  LOCAL  TIME: 


08/18/97  17:39:42 
08/18/97  17:39:42 

:  "12 . . . 

AWOS  DATE  TM  RESP 
15 
-1 


INPUT  MESSAGE  #: 


RECEIVE  TIME  (IPS) : 
RECEIVE  TIME  (ADAS) 
SIMULATOR  ID: 
MESSAGE  TYPE: 
MESSAGE  SIZE: 

GROUP  ID: 


08/18/97  17:39:12 
08/18/97  17:39:12 
12 

AWOS  ADAS  TEST  MSG 

. . 32 . 

-1 


MESSAGE  TYPE:  ADAS  Test  Message  Adu 


FORMAT  ID: 

FORMAT  TYPE: 
LENGTH  INDICATOR: 
ADAS  ID: 

DATE: 

TIME: 

RESERVED: 


0 

8 

30 

K001 

08/18/97 

17:39  AWOS  S/W  VERSION: 


OUTPUT  MESSAGE  #: 


TRANSMIT  TIME  (IPS) : 
TRANSMIT  TIME  (ADAS) 
TIME  OFFSET: 

STATION  ID: 

MESSAGE  TYPE: 

FILE  NAME: 

FIELD  NUMBER: 

FIELD  VALUE: 


08/18/97  17:39:42 
08/18/97  17:39:42 
0 

12 

ADAS  DATE  TM  REQ 
aw_dtreq/std 
0 

FIELD  OFFSET: 

0 

0 

0 


FIELD  SIZE: 


OUTPUT  MESSAGE  #: 


TRANSMIT  TIME  (IPS) : 
TRANSMIT  TIME  (ADAS) 
TIME  OFFSET: 

STATION  ID: 

MESSAGE  TYPE: 


08/18/97  17:39:11 
08/18/97  17:39:11 
0 

12 

ADAS  TEST  MSG  REQ 
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FILE  NAME: 
FIELD  NUMBER: 
FIELD  VALUE: 


OUTPUT  MESSAGE  ; 

TRANSMIT  TIME 
TRANSMIT  TIME 
TIME  OFFSET: 
STATION  ID: 
MESSAGE  TYPE: 
FILE  NAME: 
FIELD  NUMBER: 
FIELD  VALUE: 


aw_treq/std 

0 

FIELD  OFFSET: 

0 

0 

0 


FIELD  SIZE: 

1  0 

1  0 

1  0 


:  2 

(IPS) :  08/18/97  17:40:12 

(ADAS) :  08/18/97  17:40:12 
0 

12  . 

ADAS  TEST  MSG  REQ  . ■ '  -  - . . . . . _ 1?R2 

aw_treq/bogus 

0 

FIELD  OFFSET:  FIELD  SIZE: 

0  10 

0  1  0 

0  1  o 
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C.4.7.2.  TCF  Test  Procedure  Steps 

The  following  test  procedure  steps,  referenced  by  evaluation  criteria  "a"  of  this  test’s  'Data  Reduction  and  Analysis  Method 
paragraph  in  the  main  body  of  this  report,  were  extracted  from  test  procedure  file  "IN-09. TCF". 
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TEST  #  IN-09  TESTED  BY:  _  Jock  K.  Stratton  _  DATE:  18/AUG/97  TIME:  17:35_  TEST  DIRECTOR'S  INITIALS 
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C.4.8.  TEST  IN-10  -  ADAS  Originated  Date/Time/Test  Msg. 

The  following  paragraphs  provide  information  about  data  associated  with  this 
test  but  not  included  within  the  main  body  of  this  report. 


C.4.8.1.  Associated  Evaluation  Criteria  and  Data 

The  following  Evaluation  Criteria  were  used  to  determine  the  requirements 
passed/ failed .  The  Cross  Reference  (CR)  numbers  can  be  used  to  trace  into  the 
data  found/referenced  below. 

Pass  Fail 

]  Each  procedure  step's  "pass"  box,  in  the  'Observed  Results' 
column,  was  marked,  indicating  the  'Expected  Response'  was 
observed.  (See  Appendix  C  for  the  test  procedure  performed 
for  test  IN-10.) 

]  Each  request  must  produce  an  Event  message  in  the  ADAS  Event 
log,  contained  in  the  IPS  Inbound  Message  log  CR1-4  (Type  I 
20)  . 

]  The  ADAS  Error  log  must  contain  the  two  errors  returned  by 
the  AWOS  simulators  CR5&6.  I 


]  The  ADAS  Event  log  must  contain  the  two  Events  for  the 
errors  returned  by  the  AWOS  simulators  CR7&8  (Type  21). 

]  Successful  completion  of  the  manual  procedures  for  this  test 
case  indicates  the  returned  time/date  response 
time  and  date  that  was  synchronized  with 

the  IPS  test  time. 


a.  [XX] 

b.  [XX] 

c.  [XX]  [ 

d.  [XX]  [ 

e.  [XX]  [ 

indicates  a 


The  following  data,  marked  with  evaluation  criteria  cross-reference  numbers, 
is  a  subset  of  the  OT&E  formal  test  run  data.  Other  relavent  data  has  been 
included  into  IN-10 's  Test  Conduct  Form  (TCF)  file,  "IN-10. TCF". 


EVENT  PRIORITY:  normal  DATE/TIME  STAMP:  08-20-97  18:00:56 

EVENT  SEQ.  NUMBER:  254  EVENT  TYPE:  20  CSC  ID:  14.01 

ADAS  specialist  has  issued  a  command  request. 

specialist  cmd:  [TEST  MESSAGE  CMDS]  -  SEND  AWOS  TEST  MSG 


EVENT  PRIORITY:  normal  DATE/TIME  STAMP:  08-20-97  18:01:42 

EVENT  SEQ.  NUMBER:  262  EVENT  TYPE:  20  CSC  ID:  14.01 

ADAS  specialist  has  issued  a  command  request. 

specialist  cmd:  [TEST  MESSAGE  CMDS]  -  SEND  AWOS  TEST  MSG 

EVENT  PRIORITY:  normal  DATE/TIME  STAMP:  08-20-97  18:02:44 


|CR1 


|CR2 
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EVENT  SEQ.  NUMBER:  270  EVENT  TYPE:  20  CSC  ID:  14.01 

ADAS  specialist  has  issued  a  command  request. 

specialist  cmd:  [TEST  MESSAGE  CMDS]  -  SEND  AWOS  TEST  MSG _ 

EVENT  PRIORITY:  normal  DATE/TIME  STAMP:  08-20-97  18:03:00 
EVENT  SEQ.  NUMBER:  272  EVENT  TYPE:  20  CSC  ID:  14.01 

ADAS  specialist  has  issued  a  command  request. 

specialist  cmd:  [TEST  MESSAGE  CMDS]  -  SEND  AWOS  TEST  MSG . 

EVENT  PRIORITY:  non-critical  DATE/TIME  STAMP:  08-20-97  18:02:46 

EVENT  SEQ.  NUMBER:  271  EVENT  TYPE:  21 . CSC  ID:11.02 

An  erroneous  message  has  beenmtr_ig_gejcedMby_System_jLog^ihg_._ 

interface  id :  K001  message  type:  ADAS  received  error  message 

error"" type" : " ’AWOS ~ erroFies^gie . '  error  code:  Date  exception . 

original  esc  id;  3.02  error  number:  1 
error  offset:  0 

EVENT  PRIORITY:  non-critical  DATE/TIME  STAMP:  08-20-97  18:03:01 

EVENT  SEQ.  NUMBER:  274  EVENT  TYPE:  21 . CSC  ID:  11.02 

An  erroneous  message  has  been  triggered  by  System  Logging. 

interface  id:  K002  message  ...type:  ...ADAS  ...received^error  _  mesM 

~"eTroF'"t^e"r‘AWo¥"'e"r"ror""message  error  code:  Date  exception . 

. origina  1  csc  id':  3.02  error  number:  2 

error  offset:  64 

EVENT  NUMBER:  271  DATE/TIME  STAMP:  08-20-97  18:02:46 

ERROR  SEQ.  NUMBER:  1  CSC  ID:  3.02 
MESSAGE  TYPE:  0 

ERROR  TYPE:  106  ERROR  CODE:  103 

ORIG.  AWOS  ID:  K001 

2420  4B30  3031  0000  6108  1412  020A  5858  5858  5858  5858  5858 
5858  5858’  58  58  58  58  5858 . . . . . . . 

EVENT  NUMBER:  274 
ERROR  SEQ.  NUMBER:  2 
MESSAGE  TYPE:  0 
ERROR  TYPE:  106 
ORIG.  AWOS  ID:  K002 

2420  4B30  3032  0000  6108  1412  030A  5858  5858  5858  5858  5858 

5858  5858  5858  5858  5858 . . .  . 


DATE/TIME  STAMP:  08-20-97  18:03:01 
CSC  ID:  3.02 

ERROR  CODE:  103 


|CR3 


|CR4 


iCR7 


CR8 


CR5 


CR6 
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C.4.8.2.  TCF  Test  Procedure  Steps 

The  following  test  procedure  steps,  referenced  by  evaluation  criteria  "a"  of  this  test's  'Data  Reduction  and  Analysis  Method' 
paragraph  in  the  main  body  of  this  report,  were  extracted  from  test  procedure  file  "IN-10. TCF" 
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Close  the  Event  Window.  The  response  closes.  The  "Test  Messages  [X]  Pass  [  ]  Fail  Stop  Test 

@ASC  SI:  ”<3: [Fl4]>"  Commands"  screen  is  displayed. 
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C.4.9  TEST  IN-1 2D  -  NADIN  USERS(DLP,  WARP,  WMSCR,  AND  ITWSs) 
Interface 

The  following  paragraphs  provide  information  about  data  associated  with  this 
test  but  not  included  within  the  main  body  of  this  report. 

C.4.9.1  Associated  Evaluation  Criteria  and  Data 

The  following  Evaluation  Criteria  were  used  to  determine  the  requirements 
passed/failed.  The  Cross  Reference  ( CR)  numbers  can  be  used  to  trace  into  the 
data  found/referenced  below. 


Pass  Fail 


[xx]  [  ]  Each  test  procedure  step's  "pass”  box,  in  the  'Observed 

Results'  column  is  marked,  indicating  the  'Expected 
Response'  was  observed  and/or  the  correct  action  was 
performed  successfully.  (See  Appendix  C  for  the  test 
procedures  performed  for  this  test). 


b . 

tPP] 

[ 

] 

ADAS 

CR01 

shall  disseminate  data  to  the  ITWS  via  the 
NAS-SS-1000,  Section  4. 4. 1.4,  Vol 

NADIN 

II 

Port . 
Figure 

3.2.1 

. 5.8.3-F1  ISS2-004 

c. 

[XX] 

[ 

] 

NLDN 

1000, 

to  ADAS  (216  bits  and  667  times/minute)  . 
Vol.  II  Table  3 . 2 . 1 . 5 . 8 . 3-Tlk  LSS2-024 

CR02  NAS-SS- 

d. 

[XX] 

[ 

] 

NLDN  to  ADAS  (1200  baud  rate ,  RS-232,  asynchronous) 

NAS-SS-1000,  Vol .  II  Table  3 . 2 . 1 . 5 . 8 . 3-Tlk  LSS2-024 

.  CR03 

e . 

[pp] 

[ 

] 

ADAS 

shall  disseminate  data  to  the  DLP  via  the  NADIN  Port. 

f . 

[pp] 

[ 

] 

ADAS 

shall  disseminate  data  to  the  WARP  via  the 

NADIN 

Port. 

g- 

[XX] 

[ 

] 

ADAS 

shall  disseminate  data  to  the  WMSCR  via  the  NADIN  Port. 

The  following  data,  marked  with  evaluation  criteria  cross-reference  numbers, 
is  a  subset  of  the  OT&E  formal  test  run  data.  Other  relavent  data  has  been 
included  into  test  IN-12D's  Test  Conduct  Form  (TCF)  file,  "IN-12D.TCF" . 

DATA  EXTRACTED  FROM  IPS  FILE: 

ITWS  and  NLDN :  CR01  and  CR02 

NLDN  LDP  OUTPUT  MESSAGE/ITWS1  LDP  INPUT  MESSAGE: 

10/06/97  14:59:16  FLASHMESSAGE 
7d96  b2ee  3a32  c27e 

10/06/97  14:59:16  FLASHMESSAGE 

7d96  dOee  3a32  ef76  6d3b  2248  0277  6d3b  2248  2977  6d3b  2248  db76  6d3b 
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2248  1677  6d3b  2248  3d77  6d3b  2248  5177  6d3b  2248  7877  6d3b  2248  9f77  6d3b 
2248 

3d77  6d3b  2248  6477  6d3b  2248  8c77  6d3b  2248  b377  6d3b  2248  0178  6d3b  2248 
5078 

6d3b  2248  9f78  6d3b  2248  c777  6d3b  2248  2978  6d3b  2248  0179  6d3b  2248  2879 
6d3b 

2248  4d7e 

10/06/97  14:59:16  FLASHMESSAGE 
7d96  dOee  3a32  a07e 


INPUT  MESSAGE  #:  23 


RECEIVE  TIME  (IPS 

)  : 

10/06/97 

14:59:21  | 

RECEIVE  TIME  (ADAS) : 

10/06/97 

18:59:21 

SIMULATOR 

ID: 

6 

MESSAGE  TYPE: 

ITWS1 

LDD 

MSG 

MESSAGE  SIZE: 

182 

GROUP  ID: 

25 

MESSAGE  TYPE:  ITWS1 

LDD 

HEADER: 

0x01 

TYPE: 

LD 

GEOGRAPHIC 

DESIG: 

US 

BULLETIN: 

27 

SITE  ID: 

KACY 

DAY/HOUR/MINUTE: 

06/18/59 

Number  of  Message 

5 

3 

LDD 

FORMAT 

IN  HEXDECIMAL 

LENGTH  INDICATOR 

04 

DATE/TIME  FIELD 

:b2 

ee 

3a 

32 

LENGTH  INDICATOR 

7c 

DATE/TIME  FIELD 

dO 

ee 

3a 

32 

FLASH 

RECORD 

#01 

ef 

76 

6d 

3b 

22 

48 

FLASH 

RECORD 

#02 

02 

77 

6d 

3b 

22 

48 

FLASH 

RECORD 

#03 

29 

77 

6d 

3b 

22 

48 

FLASH 

RECORD 

#04 

db 

76 

6d 

3b 

22 

48 

FLASH 

RECORD 

#05 

16 

77 

6d 

3b 

22 

48 

FLASH 

RECORD 

#06 

3d 

77 

6d 

3b 

22 

48 

FLASH 

RECORD 

#07 

51 

77 

6d 

3b 

22 

48 

FLASH 

RECORD 

#08 

78 

77 

6d 

3b 

22 

48 

FLASH 

RECORD 

#09 

9f 

77 

6d 

3b 

22 

48 

FLASH 

RECORD 

#10 

3d 

77 

6d 

3b 

22 

48 

FLASH 

RECORD 

#11 

64 

77 

6d 

3b 

22 

48 

FLASH 

RECORD 

#12 

8c 

77 

6d 

3b 

22 

48 

FLASH 

RECORD 

#13 

b3 

77 

6d 

3b 

22 

48 

FLASH 

RECORD 

#14 

01 

78 

6d 

3b 

22 

48 

FLASH 

RECORD 

#15 

50 

78 

6d 

3b 

22 

48 

FLASH 

RECORD 

#16  , 

9f 

78 

6d 

3b 

22 

48 

FLASH 

RECORD 

#17 

cl 

77 

6d 

3b 

22 

48 

FLASH 

RECORD 

#18 

29 

78 

6d 

3b 

22 

48 

FLASH 

RECORD 

#19 

01 

79 

6d 

3b 

22 

48 

FLASH 

RECORD 

#20 

28 

79 

6d 

3b 

22 

48 
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LENGTH  INDICATOR  :04 
DATE/TIME  FIELD  :d0  ee  3a  32 
No  more  messages  in  this  ADU 


ITWS : 

ADAS  AWOS  OUTPUT  MESSAGE/ITWS1  AWOS  INPUT  MESSAGE: 


OUTPUT  MESSAGE  #:  57 


TRANSMIT  TIME 
T  RAN  SM  I T  T I ME 

. TIME  OFFSET : . 

STATION  ID: 
MESSAGE  TYPE: 
FILE  NAME: 
FIELD  NUMBER: 
FIELD  VALUE: 


(IPS) :_  10/06/97  15:00:02 
(ADAS )  .''36/06/97  19 :  00:  02 

. : . ■ . . "o . 

12 

ADAS_AWOS_MSG 

aw_msg/std 

0 

FIELD  OFFSET: 

0 

0 

0 


DR  of  IN-12DB. HAW  for  messages/site  count. 


FIELD  SIZE: 

1 

1 

1 


0 

0 

0 


##  New  ADU  ##  INPUT  MESSAGE  #:  4 

ADU#:  4  |  (IPS):  10/06/97  15:00:12  -  (ADAS):  10/06/97  19:00:12  |  msgs  15 

HdFr~sTm-6'"'i''"ADU""si¥e':"''i2lT'T.TVpe7"'TTWSl''''Awos . KACY  j  OMO's  =  OxOf 

K006  K011  K010  K002  K003  K005  K012  K004’  K00~9  K007  K001  K008  K015  K013  K014 


DLP : 

ADAS  AWOS  OUTPUT  MESSAGE/DLP  AWOS  INPUT  MESSAGE: 


OUTPUT  MESSAGE  # 

• 

57 

TRANSMIT  TIME 

(IPS)  : 

10/06/97  15:00:02 

TRANSMIT  TIME 

(ADAS ) 

:  10/06/97  19:00:02 

TIME  OFFSET: 
STATION  ID: 
MESSAGE  TYPE: 
FILE  NAME: 
FIELD  NUMBER: 

0 

12 

ADAS_AWOS_MSG 
aw  msg/std 

0 

FIELD  VALUE: 

FIELD  OFFSET: 

0 

0 

0 

FIELD  SIZE 

1 

1 

1 

C-225 

DR  of  IN-12DB.DLPA  for  messages/site  count. 


##  New  ADU  ##  INPUT  MESSAGE  #:  4 

ADU#:  4  |  (IPS) :  10/06/97  15:00:07  -  (ADAS):  10/06/97  19:00:07  |  msqs  15 
Hdr :  Sim-2  |  ADU  size:  1169  |  Type:  DLP  Awos  |  OMO's  =  15 
K006  K011  K010  K002  K003  K005  K012  K00’4~K009  K007  K001  K008  K015  K013  K014 


RWP(WARP) : 

ADAS  AWOS  OUTPUT  MESSAGE/RWP (WARP )  AWOS  INPUT  MESSAGE: 


OUTPUT  MESSAGE  #:  57 


TRANSMIT  TIME  (IPS):  10/06/97  15:00:02 
TRANSMIT  TIME  (ADAS):  10/06/97  19:00:02 

o . . . . 


TIME  OFFSET: 
STATION  ID: 
MESSAGE  TYPE: 
FILE  NAME: 
FIELD  NUMBER: 
FIELD  VALUE: 


12 

ADAS  _AW  O  S  _M  S  G 
aw_msg/std 
0 

FIELD  OFFSET: 

0 

0 

0 


FIELD  SIZE: 

1 

1 

1 


0 

0 

0 


DR  of  IN-12DB.RWPA  for  messages/site  count. 


##  New  ADU  ##  INPUT  MESSAGE  #:  4 

ADU#:  4  |  (IPS):  10/06/97  15:00:07  -  (ADAS):  10/06/97  19:00:07  I  msgs  15 
Hdr:  Sim-4  |  ADU  size:  Il69  |  Type:  RWP  Awos  |  OMO’s  =  15 
K006  K011  K010  K002  K003  K005  K012’’"k004"’ K009  K007  K001  K008  K015  K013  K014 


WMSCR: 

ADAS  AWOS  OUTPUT  MESSAGE/WMSCR  METAR  INPUT  MESSAGE 


OUTPUT  MESSAGE  #:  57 


TRANSMIT  TIME  (IPS) : 
TRANSMIT  TIME  (ADAS)~ 
TIME  OFFSET: 

STATION  ID: 

MESSAGE  TYPE: 

FILE  NAME: 

FIELD  NUMBER: 

FIELD  VALUE: 


10/06/97  15:00:02 
:  10/ 06/97  19: OPT  02 
0 

12 

ADAS_AWOS_MSG 
aw_msg/ std 
0 

FIELD  OFFSET: 
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FIELD  SIZE: 


0 

0 

0 


1 

1 

1 


0 

0 

0 


INPUT  MESSAGE  #: 

RECEIVE  TIME  (IPS) : 
RECEIVE  TIME  (ADAS) 
SIMULATOR  ID: 
MESSAGE  TYPE: 
MESSAGE  SIZE: 

GROUP  ID: 

MESSAGE  TYPE:  WMSCR 
HEADER: 

RESERVED: 

TYPE: 

GEOGRAPHIC  DESIG: 
BULLETIN: 

SITE  ID: 

DAY/HOUR/MINUTE : 
DATA: 


6 

10/06/97  15:00:07 
10/06/97  19:00:07 

5  . - . 

WMS  CR_METAR_ME 
675 
12 

METAR  Message 
0xe8 

SA 

US 

27 

KACY 

06/19/00 


METAR  K005  061900  AUTO  00000KT  1  3/4SM  R01C/P6000FT  CLR  26/20 

METAR  K012  061900Z  AUTO  2101G24KT  180V240  1  3/4SM  R01/3000FT  CLR  26/20  A2998 
RMK  A0 2  SLP000 

METAR  K002  061900Z  AUTO  04005G15KT  7SM  R01/3000FT  FC  22/06  A2998  RMK  TORNADO 
A02  FCB00  SLP000 

METAR  K015  061900Z  AUTO  2101G24KT  180V240  1  3/4SM  R01/3000FT  CLR  26/20  A2998 
RMK  A0 2  SLP000 

METAR  K013  061900Z  AUTO  2101G24KT  180V240  1  3/4SM  R01/3000FT  CLR  26/20  A2998 
RMK  AO 2  SLP000 

METAR  K014  061900Z  AUTO  2101G24KT  180V240  1  3/4SM  R01/3000FT  CLR  26/20  A2998 
RMK  AO 2  SLP000 

METAR  K001  061900Z  AUTO  04005G15KT  7SM  R01/3000FT  22/06  A2998  RMK  A02  SLP000  | 
TOTAL  messages  7 


No  more  messages  in  this  ADU 


WMSCR: 

ADAS  METAR  OUTPUT  MESSAGE /WMSCR  METAR  INPUT  MESSAGE 


OUTPUT  MESSAGE  #:  19 


TRANSMIT  TIME 

(IPS)  : 

10/06/97  15:00:00 

TRANSMIT  TIME 

(ADAS )  : 

10/06/97  19:00:00 

TIME  OFFSET: 

0 

STATION  ID: 

17 

MESSAGE  TYPE: 

ADAS  METAR  MSG 

FILE  NAME: 

aw  metar/spec  std 

FIELD  NUMBER: 

0 

FIELD  VALUE: 

FIELD  OFFSET: 

FIELD  SIZE 

0 

1 

0 

1 

0 

1 

C-227 


INPUT  MESSAGE  #: 


5 


RECEIVE  TIME  (IPS) : 
RECEIVE  TIME  (ADAS) 
SIMULATOR  ID: 
MESSAGE  TYPE: 
MESSAGE  SIZE: 

GROUP  ID: 

MESSAGE  TYPE:  WMSCR 
HEADER: 

RESERVED : 

TYPE: 

GEOGRAPHIC  DESIG: 
BULLETIN: 

SITE  ID: 

DAY/HOUR/MINUTE : 
DATA: 


10/06/97  15:00:07 
10/06/97  '19:00:07 

5 

WMSCR  METAR  ME 
107  ■ 

11 

METAR  Message 
0xe8 

SA 

US 

27 

KACY 

06/19/00 


?..?®5'.?...K.P.P.®...0_6190JDZ___AUTO___2101-G24KT_180V240  1  3/4SM  R01C/P6000FT  CLR  26/20 

TOTAL  messages  1  " 

No  more  messages  in  this  ADU 


WMSCR 

ADAS  AWOS  OUTPUT  MESSAGE/WMSCR  METAR  INPUT  MESSAGE 


OUTPUT  MESSAGE  #:  64 

TRANSMIT  TIME  (IPS):  10/06/97  15:00:58 
TRANSMIT  TIME  (ADAS):  10/06/97  19:00:58 


TIME  OFFSET: 
STATION  ID: 
MESSAGE  TYPE: 
FILE  NAME: 
FIELD  NUMBER: 
FIELD  VALUE: 


0 

13 

ADAS  AWOS  MSG 
aw_msg/ std 
1 

FIELD  OFFSET: 

0 

0 

0 


FIELD  SIZE: 
14 
1 
1 


1 

0 

0 


INPUT  MESSAGE  #:  7 


RECEIVE  TIME  (IPS) : 
RECEIVE  TIME  (ADAS) 
SIMULATOR  ID: 
MESSAGE  TYPE: 
MESSAGE  SIZE: 

GROUP  ID: 


10/06/97  15:01:04 
10/06/97  19:01:04 
5 

WMSCR  METAR  ME 

. . 204 . 

16 


C-228 


MESSAGE  TYPE:  WMSCR  METAR  Message 


HEADER:  0xe8 

RESERVED: 

TYPE:  SA 

GEOGRAPHIC  DESIG:  US 

BULLETIN:  27 

SITE  ID:  KACY 

DAY/HOUR/MINUTE:  06/19/01 

DATA: 


SPECI  K002  061901Z  AUTO  04005G15KT  7SM  R01/3000FT  22/06  A2998  RMK  A02  FCE01 
SLP000 

SPECI  K006  061901Z  AUTO  2101G24KT  180V240  1  3/4SM  R01C/P6000FT  CLR  26/20 

TOTAL  messages  2 

No  more  messages  in  this  ADU 


WMSCR 

ADAS  SUMMARY  OUTPUT  MESSAGE/ WMSCR  SUMMARY  INPUT  MESSAGE 


OUTPUT  MESSAGE  #:  10 


TRANSMIT  TIME  (IPS) : 

10/06/97  15:00:02 

TRANSMIT  TIME  (ADAS) 

:  10/06/97  19:00:02 

TIME  OFFSET: 

0 

STATION  ID: 

20 

MESSAGE  TYPE: 

ADAS  SUMMARY  MSG 

FILE  NAME: 

aw  summ/month  std 

FIELD  NUMBER: 

0 

FIELD  VALUE: 

FIELD  OFFSET: 

FIELD 

SIZE: 

0 

1 

0 

0 

1 

-  ' 

0 

0 

1 

0 

OUTPUT  MESSAGE  #: 

11 

TRANSMIT  TIME  (IPS) : 

10/06/97  15:00:02 

TRANSMIT  TIME  (ADAS) 

:  10/06/97  19:00:02“ 

TIME  OFFSET: 

0 

STATION  ID: 

18 

MESSAGE  TYPE: 

ADAS  SUMMARY  MSG 

FILE  NAME: 

aw  summ/dlyl  std 

FIELD  NUMBER: 

0 

FIELD  VALUE: 

FIELD  OFFSET: 

FIELD 

SIZE: 

0 

1 

0 

0 

1 

0 

0 

1 

0 

OUTPUT  MESSAGE  #: 

12 

TRANSMIT  TIME  (IPS) : 

10/06/97  15:00:02 

TRANSMIT  TIME  (ADAS) 

:  10/06/97  19:00:02 

C-229 


TIME  OFFSET: 
STATION  ID: 
MESSAGE  TYPE: 
FILE  NAME: 
FIELD  NUMBER: 
FIELD  VALUE: 


0 

19 

ADAS  SUMMARY  MSG 
aw_summ/dly2_std 
0 

FIELD  OFFSET: 

0 

0 

0 


FIELD  SIZE: 

1 

1 

1 


INPUT  MESSAGE  #:  5 


RECEIVE  TIME  (IPS):  10/06/97  15:00:07 

RECEIVE  TIME  (ADAS)": . i'0/067'97 ’  l'9i00 :07 

SIWLATOR  ID  : . .  . . . 5 . . . ' '  " . 

MESSAGE  TYPE:  WMSCR_SUMM_MSG 

MESSAGE  SIZE:  156 

GROUP  ID:  14 

MESSAGE  TYPE:  WMSCR  SUMMARY  Message 
HEADER:  0xe8 

RESERVED: 


TYPE:  CD 

GEOGRAPHIC  DESIG:  US 

BULLETIN:  27 

SITE  ID:  KACY 

DAY/HOUR/MINUTE:  06/19/00 

DATA: 


- : Primary  Daily  Summary  Message : 

KQ08 - 1900-06-10— - : Intermediate  Daily  Summary  Message : 

TOTAL  messages  2 

No  more  messages  in  this  ADU 


INPUT  MESSAGE  #: 

_ RECEIVE  TIME  (IPS) : 

RECEIVE  "TIME  (ADAS")  : 
SIMULATOR  ID: 

MESSAGE  TYPE: 
MESSAGE  SIZE: 

GROUP  ID: 

MESSAGE  TYPE:  WMSCR 
HEADER: 

RESERVED: 

TYPE: 

GEOGRAPHIC  DESIG: 
BULLETIN: 

SITE  ID: 

DAY/HOUR/MINUTE : 
DATA: 


6 

10/06/97  15:00:07 
1 0 / 6  6/97  19:6  0: 07 
5 

WMSCR  SUMM  MSG 

. 85 

15 

SUMMARY  Message 
0xe8 

CS 

US 

27 

KACY 

06/19/00 


C-230 


o  o  o 


K009 — ——10 - - - : Monthly  Summary  Message: 

TOTAL  messages  1 

No  more  messages  in  this  ADU 


WMSCR 

ADAS  METAR  OUTPUT  MES SAGE /WMSCR  METAR  INPUT  MESSAGE 


OUTPUT  MESSAGE  #:  21 


TRANSMI T  TIME  (IPS): 
TRANSMIT  "TIME  "'(ADAS)' 

. TIME  OFFSET  : . 

STATION  ID: 

MESSAGE  TYPE: 

FILE  NAME: 

FIELD  NUMBER: 

FIELD  VALUE: 


10/06/97  15:00:02 
: ”10/06797  "19:  00702 

. o . . . : 

16 

ADAS  METAR  MSG 
aw_metar/met_std 
0 

FIELD  OFFSET: 

0 

0 

0 


FIELD  SIZE: 

1 

1 

1 


0 

0 

0 


INPUT  MESSAGE  #:  6 


RECEIVE  TIME  (IPS)  : . 

RECEIVE  TIME  (ADAS)V 
SIMULATOR  ID: 

MESSAGE  TYPE: 

MESSAGE  SIZE: 

GROUP  ID: 

MESSAGE  TYPE:  WMSCR 
HEADER: 

RESERVED: 

TYPE: 

GEOGRAPHIC  DESIG: 
BULLETIN: 

SITE  ID: 

DAY/HOUR/MINUTE: 

DATA: 


10/06/97  15:00:07 
(L  0  7  06/97  19:00  :  0  7 
5 

WMSCR  METAR  ME 

.  675 . . 

12 

METAR  Message 
0xe8 

SA 

US 

27 

KACY 

06/19/00 


METAR  K005  061900  AUTO  00000KT  1  3/4SM  R01C/P6000FT  CLR  26/20 

METAR  K012  061900Z  AUTO’  2101G24KT'  18  0V24  0  1  3/4SM  R01/3000FT  CLR  26/20  A2998 
RMK  A0 2  SLP000 

METAR  K002  061900Z  AUTO  04005G15KT  7SM  R01/3000FT  FC  22/06  A2998  RMK  TORNADO 
A0 2  FCB00  SLP000 

METAR  K015  061900Z  AUTO  2101G24KT  180V240  1  3/4SM  R01/3000FT  CLR  26/20  A2998 
RMK  A02  SLP000 


C-231 


METAR  K013  061900Z  AUTO  2101G24KT  180V240  1  3/4SM  R01/3000FT  CLR  26/20  A2998 
RMK  AO 2  SLP000 

METAR  K014  061900Z  AUTO  2101G24KT  180V240  1  3/4SM  R01/3000FT  CLR  26/20  A2998 
RMK  A02  SLP000 

METAR  K001  061900Z  AUTO  04005G15KT  7SM  R01/3000FT  22/06  A2998  RMK  A02  SLP000 

TOTAL  messages  7 

No  more  messages  in  this  ADU 


WMSCR 

ADAS  SHEF  OUTPUT  MESSAGE/WMSCR  SHEF  INPUT  MESSAGE 


OUTPUT  MESSAGE  #: 

TRANSMIT  TIME  (IPS) : 

7 

10/06/97  15:00:00 

TRANSMIT  TIME  (ADAS) 

:  10/06/97  19:00:00 

TIME  OFFSET: 

0 

STATION  ID: 

22 

MESSAGE  TYPE: 

ADAS  SHEF  MSG 

FILE  NAME: 

aw  shef/shef2  std 

FIELD  NUMBER: 

0 

FIELD  VALUE: 

FIELD  OFFSET: 

FIELD 

SIZE: 

0 

1 

0 

0 

1 

0 

0 

1 

0 

OUTPUT  MESSAGE  # 

:  8 

TRANSMIT  TIME 

(IPS) :  10/06/97  15:00:00 

TRANSMIT  TIME 

(ADAS):  10/06/97  19:00:00 

TIME  OFFSET: 

0 

STATION  ID: 

21 

MESSAGE  TYPE: 

ADAS  SHEF  MSG 

FILE  NAME: 

aw  shef/shefl  std 

FIELD  NUMBER: 

0 

FIELD  VALUE: 

FIELD  OFFSET: 

FIELD 

SIZE: 

0 

1 

0 

0 

1 

0 

0 

1 

0 

INPUT  MESSAGE  #:  4 

RECEIVE  TIME  (IPS):  10/06/97  15:00:07 

RECEIVE  TIME  (ADAS):  10/06/97  19:00:07 

S  iMULATORID: . . " . 5 . 

MESSAGE  TYPE:  WMSCR  SHEF  MSG 

MESSAGE  SIZE:  140 

GROUP  ID:  13 

MESSAGE  TYPE:  WMSCR  SHEF  Message 


C-232 


0xe8 


HEADER : 

RESERVED: 

TYPE:  SR 

GEOGRAPHIC  DESIG:  US 

BULLETIN:  27 

SITE  ID:  KACY 

DAY/HOUR/MINUTE:  06/19/00 

DATA: 

- K0 11-1006 - 1900 - : jSHEF  15-minute  Precip: 

ZTTTrKOioIio.o6---190'0---T;SHEF  Hourly  Routine  Precip : 

TOTAL  messages  2 

No  more  messages  in  this  ADU 


WMSCR 

WMSCR  METAR  INPUT  MESSAGE 


INPUT  MESSAGE  #:  11 

RECEIVE  TIME  (IPS):  10/06/97  15:04:17 

RECEIVE  TIME  (ADAS):  10/06/97  20:01:17 

SIMULATOR  ID:  5 

MESSAGE  TYPE:  WMSCR_METAR_ME 

MESSAGE  SIZE:  218 

GROUP  ID:  5 

MESSAGE  TYPE:  WMSCR  METAR  Message 
HEADER:  0xe8 

RESERVED: 

TYPE:  SA 

GEOGRAPHIC  DESIG:  US 

BULLETIN:  27 

SITE  ID:  KACY 

DAY/HOUR/MINUTE:  06/20/01 

DATA: 

S PECI  K002  061902Z  AUTO  04005G 15KT  7SM  R01/3000FT  FC  22/06  A2998  RMK  TORNADO 
AO2'FCE01B02'sLP000 . 

SPECI  K006  061901Z  AUTO  21Q1G24KT  180V240  1  3/4SM  R01C/P6000FT  CLR  26/20 

TOTAL  messages  2 

No  more  messages  in  this  ADU 


INPUT  MESSAGE  #:  12 


RECEIVE  TIME  (IPS) : 


RECEIVE  TIME  (ADAS) 


SIMULATOR  ID 
MESSAGE  TYPE 
MESSAGE  SIZE 
GROUP  ID: 


10/06/97  15:04:21 
16706/97  20 : 01 : 21 

. 5 . 

WMSCR_METAR_ME 

1465 

6 


C-233 


MESSAGE  TYPE:  WMSCR 

METAR  Mess 

HEADER: 

0xe8 

RESERVED: 

TYPE: 

SA 

GEOGRAPHIC  DESIG: 

US 

BULLETIN: 

27 

SITE  ID: 

KACY 

DAY/HOUR/MINUTE: 

06/20/01 

DATA: 

METAR  K013  062001Z  AUTO  2101G24KT  180V240  1  3/4SM  R01/3000FT  CLR  26/20  A2998 
RMK  A02  SLP000 

METAR  K015  062001Z  AUTO  2101G24KT  180V240  1  3/4SM  R01/3000FT  CLR  26/20  A2998 
RMK  A02  SLP000 

METAR  K012  062001Z  AUTO  2101G24KT  180V240  1  3/4SM  R01/3000FT  CLR  26/20  A2998 
RMK  AO 2  SLPOOO 

062001  AUTO  00000KT  1  3/4SM  R01C/P6000FT  CLR  26/20 
M?.T^R  KOOl  06200055  AUTO  64005Gi5kT  7SM  ROl/iioCjOFT  22/06  A2998  RMK  AO 2  SLPOOO 

METAR  KO 0 2  062 00 0 Z . AUTO  04005’g1'5KT . 7SM . RO 1 73 00 OFT . 2 2/0 6  "1^2 9 9 8 . RMK . AO 2 

FCE01B02E00  SLPOOO 

METAR  K014  062000Z  AUTO  2101G24KT  180V240  1  3/4SM  R01/3000FT  CLR  26/20  A2998 
RMK  AO 2  SLPOOO 

METAR  K013  062000Z  AUTO  2101G24KT  180V240  1  3/4SM  R01/3000FT  CLR  26/20  A2998 
RMK  AO 2  SLPOOO 

METAR  K015  062000Z  AUTO  2101G24KT  180V240  1  3/4SM  R01/3000FT  CLR  26/20  A2998 
RMK  AO 2  SLPOOO 

METAR  K005  062000  AUTO  00000KT  1  3/4SM  R01C/P6000FT  CLR  26/20 

METAR  K012  062000Z  AUTO  2101G24KT  180V240  1  3/4SM  R01/3000FT  CLR  26/20  A2998 
RMK  AO 2  SLPOOO 

METAR  K014  061902Z  AUTO  2101G24KT  180V240  1  3/4SM  R01/3000FT  CLR  26/20  A2998 
RMK  AO 2  SLPOOO 

METAR  K013  061902Z  AUTO  2101G24KT  180V240  1  3/4SM  R01/3000FT  CLR  26/20  A2998 
RMK  A02  SLPOOO 

METAR  K015  061902Z  AUTO  2101G24KT  180V240  1  3/4SM  R01/3000FT  CLR  26/20  A2998 
RMK  AO 2  SLPOOO 

METAR  K005  061901  AUTO  00000KT  1  3/4SM  R01C/P6000FT  CLR  26/20 

METAR  K012  061901Z  AUTO  2101G24KT  180V240  1  3/4SM  R01/3000FT  CLR  26/20  A2998 
RMK  A02  SLPOOO 

TOTAL  messages  16 

No  more  messages  in  this  ADU 


DATA  EXTRACTED  FROM  ADAS  FIT.W  ; 

CWM  ERR. LOG  (Represents  data  sent  out  by  ADAS) 


Oct  6  19:00:07  1997  5.01  do_iso_evt{)  -  ISO_ADU_SENT  message  received 

. §  .--19 : 0° : 07  1997  5.01  wmo  confirmed  transmittal  SPECI  confirm  i_d=>12  #=>1  | 

^£5 — 6.19:00:08  1997  5.01  wmo  confirmed  transmittal  METAR  confirm  id=>13  #=>7  | 


C-234 


Oct  6  19:00:08  1997  5.01  wmo  confirmed  transmittal  SHEF  confirm  id=>14  #=>2 

Oct  6  19:00:09  1997  5 .01  wmo  confirmed  transmittal  DAILY  SUMMARY 

confirm  id=>15  #=>2 


Oct  6  19:00:09  1997  5.01  wmo  confirmed  transmittal  MONTHLY . SUMMARY 

confirm  id=>16  #=>1 


Oct  6  19:01:07  1997  5.01  wmo  confirmed  tfansmittal  SPECI  confirm  id=>17  #=>2 

Oct . 6  19 : 01 : 07  1997  5  ^  01  wmo^conf irmed_transmittal  METAR  confirm_id=>i8  #=>5 

Oct  6  19:01:07  1997  5.01  wmo_confirmed_transmittal  SHEF  confirm_id=>19  #=>2 

Oct  6  19:01:07  1997  5.01  wmo_conf irmed_transmittal  DAI LY_SUMMARY 

confirm  id=>20  #=>2 

Oct  6  19:01:07  1997  5.01  wmo_conf irmed_transmittal  MONTHLY  SUMMARY 

confirm  id=>21  #=>1 


CHD  ERR . jjQG  ( Rgp^_es ent s  data  received  by  ADAS) 


Oct 

6 

19:00:02 

1997 

3.02 

ADU 

proc { ) 

site  =>K011 

f ormat_ 

id  =>0, 

forma t_ 

type 

=>11 

Oct 

6 

19:00:02 

1997 

3.02 

ADU 

proc ( ) 

site  =>K006 

format 

id  =>0, 

format 

type 

=>6 

Oct 

6 

19:00:02 

1997 

3.02 

ADU 

proc { ) 

site  =>K010 

format 

id  =>0, 

format 

type 

=>10 

Oct 

6 

19:00:02 

1997 

3.02 

ADU 

proc ( ) 

site  =>K006 

format._ 

id  =>0, 

format_ 

type 

=>1 

Oct 

6 

19:00:02 

1997 

3.02 

ADU 

proc ( ) 

site  =>K011 

format 

id  =>0, 

format 

type 

=>1 

Oct 

6 

19:00:03 

1997 

3.02 

ADU 

proc ( ) 

site  =>K010 

format 

id  =>0, 

format_ 

type 

=>1 

Oct 

6 

19:00:04 

1997 

3.02 

ADU 

proc  () 

site  =>K002 

format_ 

id  =>0, 

forma t_ 

type 

=>1 

Oct 

6 

19:00:04 

1997 

3.02 

ADU 

proc { ) 

site  =>K005 

format 

id  =>0, 

format 

.type 

=>5 

Oct 

6 

19:00:04 

1997 

3.02 

ADU 

proc ( ) 

site  =>K012 

format 

id  =>0, 

format 

type 

=>5 

Oct 

6 

19:00:04 

1997 

3.02 

ADU 

proc ( ) 

site  =>KO07 

format 

id  =>0, 

format 

.type 

=>12 

Oct 

6 

19:00:04 

1997 

3.02 

ADU 

proc ( ) 

site  =>K009 

format 

id  =>0, 

format 

_type 

=>14 

Oct 

6 

19:00:04 

1997 

3.02 

ADU 

proc() 

site  =>K003 

format_ 

id  =>0, 

format_ 

.type 

=>2 

Oct 

6 

19:00:04 

1997 

3.02 

ADU 

proc ( ) 

site  =>K008 

format 

id  =>0, 

format 

-type 

=>13 

Oct 

6 

19:00:04 

1997 

3.02 

ADU 

_proc  ( } 

site  =>K015 

forma  t_ 

id  =>  0  f 

format 

type 

=>5 

Oct 

6 

19:00:04 

1997 

3.02 

ADU 

proc ( ) 

site  =>K005 

format_ 

id  =>0, 

format 

.type 

=>1 

Oct 

6 

19:00:04 

1997 

3.02 

ADU 

proc ( ) 

site  =>K012 

f  ormat_ 

id  =>0, 

format 

.type 

=>1 

Oct 

6 

19:00:05 

1997 

3.02 

ADU 

proc  () 

site  =>K004 

format 

id  =>0, 

format 

.type 

=>2 

Oct 

6 

19:00:05 

1997 

3.02 

ADU 

_proc ( ) 

site  =>K013 

f  ormat_ 

id  =>0, 

format 

.type 

=>5 


C-235 


Oct 

=>1 

6 

19:00:05 

1997 

3.02 

ADU 

_proc  ( ) 

site  =>K009 

format 

_id  =>0, 

format  type 

Oct 

=>1 

6 

19:00:05 

1997 

3.02 

ADU 

_proc ( ) 

site  =>K007 

format 

_id  =>0, 

format  type 

Oct 

6 

19:00:05 

1997 

3.02 

ADU 

proc ( ) 

site  =>K001 

format 

id  =>0, 

format  type 

=>1 

Oct 

=>5 

6 

19:00:05 

1997 

3.02 

ADU 

_proc ( ) 

site  =>K014 

format 

id  =>0, 

format  type 

Oct 

=>1 

6 

19:00:05 

1997 

3.02 

ADU 

_proc  ( ) 

site  =>K008 

format 

id  =>0, 

format  type 

Oct 

=>1 

6 

19:00:05 

1997 

3.02 

ADU_ 

_proc() 

site  =>K015 

format 

id  =>0, 

format  type 

Oct 

=>1 

6 

19:00:06 

1997 

3.02 

ADU_ 

proc { ) 

site  =>K013 

format 

id  =>0, 

format_type 

Oct 

=>1 

6 

19:00:06 

1997 

3.02 

ADU_ 

_proc  ( ) 

site  =>K014 

format 

id  =>0, 

format  type 

Oct 

=>14 

6 

19:01:01 

1997 

3.02 

ADU_ 

_proc  ( ) 

site  =>K009 

format 

_id  =>0, 

format  type 

Oct 

=>1 

6 

19:01:01 

1997 

3.02 

ADU_ 

_proc  { ) 

site  =>K009 

format 

id  =>0, 

format  type 

Oct 

6 

19:01:02 

1997 

3.02 

ADU 

proc() 

site  =>K002 

format 

id  =>0, 

format  type 

=>1 

Oct 

=>5 

6 

19:01:02 

1997 

3.02 

ADU 

proc ( ) 

site  =>K012 

format 

id  =>0, 

format  type 

Oct 

=>5 

6 

19:01:02 

1997 

3.02 

ADU 

proc ( ) 

site  =>K005 

format 

id  =>0, 

format  type 

Oct 

=>1 

6 

19:01:02 

1997 

3.02 

ADU_ 

proc ( ) 

site  =>K003 

format 

id  =>0, 

format  type 

Oct 

=>12 

6 

19:01:02 

1997 

3.02 

ADU_ 

.proc  ( ) 

site  =>K007 

format 

id  =>0, 

format  type 

Oct 

=>1 

6 

19:01:02 

1997 

3.02 

ADU_ 

proc() 

site  =>K012 

format 

id  =>0, 

format  type 

COMMUNICATION  CHARACTERISTICS: 

10 

-06-97  18: 

58:34 

.  Events:  0 

.  Responses 

:  0 

.  DATAPOINT  CMDS 

»  ■  ' 

DISPLAY  NLDN  COMMUNICATIONS  LU  DATAPOINTS 
. “'“ALERT  ALARM 

DATAPOINT  NAME  ID  VALUE  CURR  PAST  CURR  PAST  LAST  RESET 


CONNECTION  STATUS:  01  CFG-ACTIVE 

14:56:45 

NLDN  FAILURES  TOTAL:  02  7 

14:56:45 

ERROR  DETECTED:  03  0 

14:56:45 

ERROR  DETECTED  TOTAL:  04  0 

14:56:45 


10-06-97 

10-06-97 

10-06-97 

10-06-97 


ALERT  THRESHOLDS 


C-236 


ALARM  THRESHOLDS 


UPPER 

LOWER 

ENAB 

UPPER 

LOWER 

ENAB 

-1 

-1 

YES 

-1 

2 

YES 

10-06-97  18:58:48 

.  Events:  0  .  Responses: 

0  .  . 

DATAPOINT  CMDS 

DISPLAY 

DLP  COMMUNICATIONS  LU 

DATAPOINTS 

DATAPOINT  NAME 

ID 

ALERT 

VALUE  CURR  PAST 

ALARM 
CURR  PAST 

LAST  RESET 

CONNECTION  STATUS: 

01 

CFG-ACTIVE 

10-06-97 

14:56:45 

AWOS  MESSAGES  SENT 

02 

30 

10-06-97 

14:56:45 

ADU  DATA  TRANSFERS 

03 

2 

10-06-97 

14:56:45 

DLP  REJECTED  MSGS: 

04 

0 

10-06-97 

14:56:45 


ALERT  THRESHOLDS 
UPPER  LOWER  ENAB 

-1  -1  YES 


ALARM  THRESHOLDS 
UPPER  LOWER  ENAB 

-1  2  YES 


10-06-97  18:58:58 

.  Events: 

0  .  Responses: 

0  . 

DATAPOINT  CMDS 

DISPLAY  WARP  COMMUNICATIONS  LU 

DATAPOINTS 

ALERT 

ALARM 

DATAPOINT  NAME 

ID  VALUE 

CURR  PAST 

CURR  PAST 

LAST  RESET 

CONNECTION  STATUS: 

01  CFG- 

-ACTIVE 

10-06-97 

14:56:45 

10-06-97 

AWOS  MESSAGES  SENT: 

02 

30 

14:56:45 

ADU  DATA  TRANSFERS: 

03 

2 

10-06-97 

14:56:45 

WARP  REJECTED  MSGS: 

04 

0 

10-06-97 

14:56:45 


ALERT  THRESHOLDS 
UPPER  LOWER  ENAB 

-1  -1  YES 


ALARM  THRESHOLDS 
UPPER  LOWER  ENAB 

-1  2  YES 


10-06-97  18:59:10  .  Events:  0  .  Responses:  0  .  DATAPOINT  CMDS  j 


DISPLAY  WMSCR  COMMUNICATIONS  LU  DATAPOINTS 

ALERT  ALARM 

DATAPOINT  NAME  ID  VALUE  CURR  PAST  CURR  PAST  LAST  RESET 


CONNECTION  STATUS: 

01 

CFG-ACTIVE 

10-06-97 

14:56:45 

METAR  MESSAGES  SENT: 

02 

12 

10-06-97 

14:56:45 

ADU  DATA  TRANSFERS: 

03 

6 

10-06-97 

14:56:45 

SHEF  MESSAGES  SENT: 

04 

4 

10-06-97 

14:56:45 

SHEF  MSG  DISCARDS: 

05 

0 

10-06-97 

14:56:45 

ALERT  THRESHOLDS 

ALARM  THRESHOLDS 

UPPER  LOWER 

ENAB 

UPPER  LOWER 

ENAB 

-1  -1 

YES 

-1  2 

YES 

ITWS1 


10-06-97  18:59:36 

.  Events : 

0  .  Responses: 

0  . 

DATAPOINT  CMDS 

• 

•  • 

DISPLAY  ITWS  COMMUNICATION  LU  DATAPOINTS 


ALERT 

ALARM 

DATAPOINT  NAME 

ID  VALUE  CURR  PAST 

CURR  PAST  LAST 

RESET 

CONNECTION  STATUS: 
14:56:45 

01 

CFG-ACTIVE 

10-06-97 

AWOS  MESSAGES  SENT: 

02 

45 

10-06-97 

14:56:45 

AWOS  ADU  MSGS  SENT: 

03 

3 

10-06-97 

14:56:45 

LDD  MESSAGES  SENT: 
14:56:45 

04 

100 

10-06-97 

LDD  ADU  SENT: 
14:56:45 

05 

23 

10-06-97 

ALERT  THRESHOLDS 

ALARM  THRESHOLDS 

UPPER  LOWER 

ENAB  UPPER 

LOWER 

ENAB 

-1 

ITWS  2 

-1 

YES  -1 

2 

YES 

10-06-97  18:59:50 

.  Events 

:  0  .  Responses: 

0  .  DATAPOINT  CMDS 

,  m 

DISPLAY  ITWS  COMMUNICATION  LU  DATAPOINTS 
. ALERT  ALARM 

DATAPOINT  NAME  ID  VALUE  CURR  PAST  CURR  PAST  LAST  RESET 


C-238 


CONNECTION  STATUS: 

01 

CFG -ACTIVE 

10-06-97 

14:56:45 

AWOS  MESSAGES  SENT: 

02 

45 

10-06-97 

14:56:45 

AWOS  ADU  MSGS  SENT: 

03 

3 

10-06-97 

14:56:45 

LDD  MESSAGES  SENT: 

04 

100 

10-06-97 

14:56:45 

LDD  ADU  SENT: 

05 

23 

10-06-97 

14:56:45 

ALERT  THRESHOLDS  ALARM  THRESHOLDS 

UPPER  LOWER  ENAB  UPPER  LOWER  ENAB 


-1 

ITWS3 

-1 

YES  -1 

2  YES 

10-06-97  19:00:04 

•  Events:  0  .  Responses: 

0  . 

DATAPOINT  CMDS 

DISPLAY 

ITWS  COMMUNICATION  LU 

DATAPOINTS 

DATAPOINT  NAME 

ID 

ALERT 

VALUE  CURR  PAST 

ALARM 
CURR  PAST 

LAST  RESET 

CONNECTION  STATUS: 

01 

CFG-ACTIVE 

10-06-97 

14:56:45 

AWOS  MESSAGES  SENT 

02 

45 

10-06-97 

14:56:45 

AWOS  ADU  MSGS  SENT 

:  03 

3 

10-06-9,/ 

14:56:45 

LDD  MESSAGES  SENT: 

04 

100 

10-06-9/ 

14:56:45 

LDD  ADU  SENT: 

05 

23 

10-06-97 

14:56:45 


ALERT  THRESHOLDS  ALARM  THRESHOLDS 

UPPER  LOWER  ENAB  UPPER  LOWER  ENAB 

-1  -1  YES  -1  2  YES 


ITWS4 


10-06-97 

19:00:21 

.  Events:  0  .  Responses: 

0  . 

DATAPOINT  CMDS 

DISPLAY 

ITWS  COMMUNICATION  LU 

DATAPOINTS 

ALERT 

ALARM 

DATAPOINT 

NAME 

ID 

VALUE  CURR  PAST 

CURR  PAST 

LAST  RESET 

CONNECTION 

STATUS : 

01 

CFG-ACTIVE 

10-06-97 

14:56:45 

AWOS  MESSAGES  SENT: 

02 

45 

10-06-97 

14:56:45 
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AWOS  ADU  MSGS  SENT: 

14:56:45 

LDD  MESSAGES  SENT: 

14:56:45 

LDD  ADU  SENT: 

14:56:45 

ALERT  THRESHOLDS  ALARM  THRESHOLDS 

UPPER  LOWER  ENAB  UPPER  LOWER  ENAB 

-1  -1  YES  -1  2  YES 


ITWS5 


10-06-97  19:00:36 

.  Events:  1  .  Responses: 

0  . 

DATAPOINT  CMDS 

•  * 

DISPLAY 

ITWS  COMMUNICATION  LU 

DATAPOINTS 

DATAPOINT  NAME 

ID 

ALERT 

VALUE  CURR  PAST 

ALARM 

CURR  PAST 

LAST  RESET 

CONNECTION  STATUS: 
14:56:45 

01 

CFG-ACTIVE 

10-06-97 

AWOS  MESSAGES  SENT: 
14:56:45 

02 

45 

10-06-97 

AWOS  ADU  MSGS  SENT: 
14:56:45 

:  03 

3 

10-06-97 

LDD  MESSAGES  SENT: 
14:56:45 

04 

112 

10-06-97 

LDD  ADU  SENT: 
14:56:45 

05 

28 

10-06-97 

ALERT  THRESHOLDS  ALARM  THRESHOLDS 

UPPER  LOWER  ENAB  UPPER  LOWER  ENAB 

"I  -1  YES  -1  2  YES 


03  3  10-06-97 
04  112  10-06-97 
05  28  10-06-97 


ITWS6 


10-06-97  19:00:49 

.  Events:  1  .  Responses: 

0  . 

DATAPOINT  CMDS  | 

•  • 

DISPLAY 

ITWS  COMMUNICATION  LU 

DATAPOINTS 

1 

DATAPOINT  NAME 

ID 

ALERT 

VALUE  CURR  PAST 

ALARM 

CURR  PAST 

1 

LAST  RESET 

CONNECTION  STATUS: 
14:56:45 

01 

CFG-ACTIVE 

■ 

10-06-97  1 

AWOS  MESSAGES  SENT 
14:56:45 

02 

45 

10-06-97 

AWOS  ADU  MSGS  SENT 
14:56:45 

03 

3 

10-06-97 

LDD  MESSAGES  SENT: 
14:56:45 

04 

112 

10-06-97 
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ADAS  EVENTS  LOG 

EVENT  PRIORITY:  non-critical  DATE/TIME  STAMP:  10-06-97  14:55:11 
EVENT  SEQ.  NUMBER:  43  EVENT  TYPE:  1  CSC  ID:  4.05 

Status  of  the  DLP  connection  has  changed. 

comm  status:  enabled-failed 

EVENT  PRIORITY:  non-critical  DATE/TIME  STAMP:  10-06-97  14:56:24  | 

EVENT  SEQ.  NUMBER:  58  EVENT  TYPE:  1  CSC  ID:  4.05 

Status  of  the  DLP  connection  has  changed. 

comm  status:  enabled-active  1 

EVENT  PRIORITY:  non-critical  DATE/TIME  STAMP:  10-06-97  20:03:08 
EVENT  SEQ.  NUMBER:  582  EVENT  TYPE:  1  CSC  ID:  4.05 

Status  of  the  DLP  connection  has  changed. 

comm  status:  enabled-failed 

EVENT  PRIORITY:  non-critical  DATE/TIME  STAMP:  10-06-97  14:55:11 
EVENT  SEQ.  NUMBER:  42  EVENT  TYPE:  2  CSC  ID:  4.01 

Status  of  the  WARP  connection  has  changed. 

comm  status:  enabled-failed 

EVENT  PRIORITY:  non-critical  DATE/TIME  STAMP: ....10-06-97 ....14.: .56: 2_3  I 

EVENT  SEQ.  NUMBER:  56  ,  EVENT  TYPE:  2  CSC  ID:  4.01 

Status  of  the  WARP  connection  has  changed. 

comm  status:  enabled-active  I 

EVENT  PRIORITY:  non-critical  DATE/TIME  STAMP:  10-06-97  20:03:04 
EVENT  SEQ.  NUMBER:  579  EVENT  TYPE:  2  CSC  ID:  4.01 

Status  of  the  WARP  connection  has  changed. 

comm  status:  enabled-failed 

EVENT  PRIORITY:  non-critical  DATE/TIME  STAMP:  10-06-97  14:55:08 
EVENT  SEQ.  NUMBER:  41  EVENT  TYPE:  12  CSC  ID:  5.01 

Status  of  the  WMSCR  connection  has  changed. 

comm  status:  enabled-failed 

EVENT  PRIORITY:  non-critical  DATE/TIME  STAMP:  10-06-97  14:56:21  | 

EVENT  SEQ.  NUMBER:  55  EVENT  TYPE TT2 . CSC  ID:  5.01 

Status  of  the  WMSCR  connection  has  changed. 
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comm  status:  enabled-active 

EVENT  PRIORITY:  non-critical  DATE/TIME  STAMP:  10-06-97  19:01:55 
EVENT  SEQ.  NUMBER:  525  EVENT  TYPE:  12  CSC  ID:  5.01 

Status  of  the  WMSCR  connection  has  changed. 

comm  status:  enabled-failed 

EVENT  PRIORITY:  non-critical  DATE/TIME  STAMP:  10-06-97  20:01:05 

EVENT  SEQ.  NUMBER:  543  EVENT  TYPE:'  12 . CSC''i"D:””"5"“01  . 

Status  of  the  WMSCR  connection  has  changed. 

comm  status:  enabled-active 

EVENT  PRIORITY:  non-critical  DATE/TIME  STAMP:  10-06-97  20:02:55 
EVENT  SEQ.  NUMBER:  574  EVENT  TYPE:  12  CSC  ID:  5.01 

Status  of  the  WMSCR  connection  has  changed. 

comm  status:  enabled-failed 


EVENT  PRIORITY:  non-critical  DATE/TIME  STAMP:  10-06-97  14:55:29 
EVENT  SEQ.  NUMBER:  44  EVENT  TYPE:  61  CSC  ID:  21.01 

Status  of  the  ITWS  connection  has  changed. 

site  id:  1001 

comm  status:  enabled-failed 

EVENT  PRIORITY:  non-critical  DATE/TIME  STAMP:  10-06-97  14:55:29 
EVENT  SEQ.  NUMBER:  45  EVENT  TYPE:  61  CSC  ID:  21.01 

Status  of  the  ITWS  connection  has  changed. 

site  id:  1002 

comm  status:  enabled-failed 

EVENT  PRIORITY:  non-critical  DATE/TIME  STAMP:  10-06-97  14:55:29 
EVENT  SEQ.  NUMBER:  46  EVENT  TYPE:  61  CSC  ID:  21.01 

Status  of  the  ITWS  connection  has  changed. 

site  id:  1003 

comm  status:  enabled-failed 

EVENT  PRIORITY:  non-critical  DATE/TIME  STAMP:  10-06-97  14:55:29 
EVENT  SEQ.  NUMBER:  47  EVENT  TYPE:  61  CSC  ID:  21.01 

Status  of  the  ITWS  connection  has  changed. 

site  id:  1004 

comm  status:  enabled-failed 

EVENT  PRIORITY:  non-critical  DATE/TIME  STAMP:  10-06-97  14:55:30 
EVENT  SEQ.  NUMBER:  48  EVENT  TYPE:  61  CSC  ID:  21.01 

Status  of  the  ITWS  connection  has  changed. 

site  id:'  1005 

comm  status:  enabled-failed 

EVENT  PRIORITY:  non-critical  DATE/TIME  STAMP:  10-06-97  14:55:33 
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EVENT  SEQ.  NUMBER:  49  EVENT  TYPE:  61  CSC  ID:  21.01 

Status  of  the  ITWS  connection  has  changed. 

site  id:  1006 

comm  status:  enabled-failed 

EVENT  PRIORITY:  non-critical  DATE/TIME  STAMP:  10-06-97  14:56:24 
EVENT  SEQ.  NUMBER:  57  EVENT  TYPE:  61  CSC  ID:  21.01 

Status  of  the  ITWS  connection  has  changed. 

site id:  1005 

comm  status:  enabled-active 

EVENT  PRIORITY :  non-critical  DATE/TIME  STAMP:  10-06-97  14:56:25 
EVENT  SEQ.  NUMBER:  59  EVENT  TYPE:  61  CSC  ID:  21.01 

Status  of  the  ITWS  connection  has  changed. 


site  id:  1001 

comm  status:  enabled-active 


EVENT  PRIORITY: 

non-critical 

DATE/TIME 

STAMP: 

10-06-97 

14:56:27 

EVENT  SEQ.  NUMBER:  60  EVENT 

Status  of  the  ITWS  connection 

TYPE:  61 
has  changed. 

CSC 

ID:  21.01 

site  id:  1006 

comm  status :  enabled-active 

EVENT  PRIORITY: 

non-critical 

DATE/TIME 

STAMP: 

10-06-97 

14:56:28 

EVENT  SEQ.  NUMBER:  61  EVENT 

Status  of  the  ITWS  connection 

TYPE:  61 
has  changed. 

CSC 

ID:  21.01 

site  id:  1002 

comm  status:  enabled-active 

EVENT  PRIORITY: 

non-critical 

DATE/TIME 

STAMP: 

10-06-97 

14:56:31 

EVENT  SEQ.  NUMBER:  64  EVENT 

Status  of  the  ITWS  connection 

TYPE:  61 
has  changed. 

CSC 

ID:  21.01 

site  id:  1003 

comm  status:  enabled-active 

EVENT  PRIORITY: 

non-critical 

DATE/TIME 

STAMP: 

10-06-97 

14:56:35 

EVENT  SEQ.  NUMBER:  67  EVENT  TYPE:  61  CSC  ID:  21.01 

Status  of  the  ITWS  connection  has  changed. 


site  id:  1004 

comm  status:  enabled- active 


EVENT  PRIORITY:  non-critical  DATE/TIME  STAMP:  10-06-97  20:02:57 
EVENT  SEQ.  NUMBER:  575  EVENT  TYPE:  61  CSC  ID:  21.01 

Status  of  the  ITWS  connection  has  changed. 

site  id:  1005 

comm  status:  enabled-failed 

EVENT  PRIORITY:  non-critical  DATE/TIME  STAMP:  10-06-97  20:03:06 
EVENT  SEQ.  NUMBER:  581  EVENT  TYPE:  61  CSC  ID:  21.01 

Status  of  the  ITWS  connection  has  changed. 
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site  id:  1004 

comm  status:  enabled-f ailed 

EVENT  PRIORITY:  non-critical  DATE/TIME  STAMP:  10-06-97  20:03:10 
EVENT  SEQ.  NUMBER:  583  EVENT  TYPE:  61  CSC  ID:  21.01 

Status  of  the  ITWS  connection  has  changed. 

site  id:  1001 

comm  status:  enabled-f ailed 

EVENT  PRIORITY:  non-critical  DATE/TIME  STAMP:  10-06-97  20:03:13 
EVENT  SEQ.  NUMBER:  584  EVENT  TYPE:  61  CSC  ID:  21.01 

Status  of  the  ITWS  connection  has  changed. 

site  id:  1006 

comm  status:  enabled-failed 

EVENT  PRIORITY:  non-critical  DATE/TIME  STAMP:  10-06-97  20:03:17 
EVENT  SEQ.  NUMBER:  585  EVENT  TYPE:  61  CSC  ID:  21.01 

Status  of  the  ITWS  connection  has  changed. 

site  id:  1003 

comm  status:  enabled-failed 

EVENT  PRIORITY:  non-critical  DATE/TIME  STAMP:  10-06-97  20:03:20 
EVENT  SEQ.  NUMBER:  586  EVENT  TYPE:  61  CSC  ID:  21.01 

Status  of  the  ITWS  connection  has  changed. 

site  id:  1002 

comm  status:  enabled-failed 


EVENT  PRIORITY:  non-critical  DATE/TIME  STAMP :  10-06-97  14:56:48 
EVENT  SEQ.  NUMBER:  73  EVENT  TYPE:  62  CSC  ID:  22.01 

Status  of  the  NLDN  connection  has  changed. 

comm  status:  enabled-active 

EVENT  PRIORITY:  non-critical  DATE/TIME  STAMP:  10-06-97  14:57:50 
EVENT  SEQ.  NUMBER:  484  EVENT  TYPE:  62  CSC  ID:  22.01 

Status  of  the  NLDN  connection  has  changed. 

comm  status:  enabled-failed 

EVENT  PRIORITY:  non-critical  DATE/TIME  STAMP:  10-06-97  14:58:02 
EVENT  SEQ.  NUMBER:  486  EVENT  TYPE:  62  CSC  ID:  22.01 

Status  of  the  NLDN  connection  has  changed. 

comm  status:  enabled-active 

EVENT  PRIORITY:  non-critical  DATE/TIME  STAMP:  10-06-97  20:03:02 
EVENT  SEQ.  NUMBER:  578  EVENT  TYPE:  62  CSC  ID:  22.01 

Status  of  the  NLDN  connection  has  changed. 

comm  status:  enabled-failed. 
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EVENT  PRIORITY:  non-critical  DATE/TIME  STAMP:  10-06-97  20:02:49 
EVENT  SEQ.  NUMBER:  559  EVENT  TYPE:  5  CSC  ID:  3.02 

Status  of  the  AWOS  connection  has  changed. 

AWOS  station  id:  K010  controller:  1 
channel :  3 

Link  Status:  link  down  Event:  link  down 


EVENT  PRIORITY:  non-critical  DATE/TIME  STAMP:  10-06-97  20:02:50 
EVENT  SEQ.  NUMBER:  560  EVENT  TYPE:  5  CSC  ID:  3.02 

Status  of  the  AWOS  connection  has  changed. 

AWOS  station  id:  K015  controller:  2 
channel :  1 

Link  Status:  link  down  Event:  link  down 

EVENT  PRIORITY:  non-critical  DATE/TIME  STAMP:  10-06-97  20:02:50 
EVENT  SEQ.  NUMBER:  561  EVENT  TYPE:  5  CSC  ID:  3.02 

Status  of  the  AWOS  connection  has  changed. 

AWOS  station  id:  K012  controller:  1 
channel:  3 

Link  Status:  link  down  Event:  link  down 


EVENT  PRIORITY:  non-critical  DATE/TIME  STAMP:  10-06-97  20:02:50 
EVENT  SEQ.  NUMBER:  562  EVENT  TYPE:  5  CSC  ID:  3.02 

Status  of  the  AWOS  connection  has  changed. 

AWOS  station  id:  K013  controller:  2 
channel:  1 

Link  Status:  link  down  Event:  link  down 

EVENT  PRIORITY:  non-critical  DATE/TIME  STAMP:  10-06-97  20:02:50 
EVENT  SEQ.  NUMBER:  563  EVENT  TYPE:  5  CSC  ID:  3.02 

Status  of  the  AWOS  connection  has  changed. 

AWOS  station  id:  K009  controller:  1 
channel:  3 

Link  Status:  link  down  Event:  link  down 


EVENT  PRIORITY:  non-critical  DATE/TIME  STAMP:  10-06-97  20:02:50 
EVENT  SEQ.  NUMBER:  564  EVENT  TYPE:  5  CSC  ID:  3.02 

Status  of  the  AWOS  connection  has  changed. 

AWOS  station  id:  K002  controller:  1 
channel :  1 

Link  Status:  link  down  Event:  link  down 

EVENT  PRIORITY:  non-critical  DATE/TIME  STAMP:  10-06-97  20:02:50 
EVENT  SEQ.  NUMBER:  565  EVENT  TYPE:  5  CSC  ID:  3.02 

Status  of  the  AWOS  connection  has  changed. 
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AWOS  station  id:  K014  controller:  2 
channel :  1 

Link  Status:  link  down  Event:  link  down 

EVENT  PRIORITY:  non-critical  DATE/TIME  STAMP:  10-06-97  20:02:50 
EVENT  SEQ.  NUMBER:  566  EVENT  TYPE:  5  CSC  ID:  3.02 

Status  of  the  AWOS  connection  has  changed. 

AWOS  station  id:  K003  controller:  1 
channel :  1 

Link  Status:  link  down  Event:  link  down 


EVENT  PRIORITY:  non-critical  DATE/TIME  STAMP:  10-06-97  20:02:51 
EVENT  SEQ.  NUMBER:  567  EVENT  TYPE:  5  CSC  ID:  3.02 

Status  of  the  AWOS  connection  has  changed. 

AWOS  station  id:  K011  controller:  1 
channel :  3 

Link  Status:  link  down  Event:  link  down 

EVENT  PRIORITY:  non-critical  DATE/TIME  STAMP:  10-06-97  20:02:51 
EVENT  SEQ.  NUMBER:  568  EVENT  TYPE:  5  CSC  ID:  3.02 

Status  of  the  AWOS  connection  has  changed. 

AWOS  station  id:  K008  controller:  1 
channel :  2 

Link  Status:  link  down  Event:  link  down 


EVENT  PRIORITY:  non-critical  DATE/TIME  STAMP:  10-06-97  20:02:51 
EVENT  SEQ.  NUMBER:  569  EVENT  TYPE:  5  CSC  ID:  3.02 

Status  of  the  AWOS  connection  has  changed. 

AWOS  station  id:  K004  controller:  1 
channel :  1 

Link  Status:  link  down  Event:  link  down 


EVENT  PRIORITY:  non-critical  DATE/TIME  STAMP:  10-06-97  20:02:51 
EVENT  SEQ.  NUMBER:  570  EVENT  TYPE:  5  CSC  ID:  3.02 

Status  of  the  AWOS  connection  has  changed. 

AWOS  station  id:  K001  controller:  1 
channel :  1 

Link  Status:  link  down  Event:  link  down 

EVENT  PRIORITY:  non-critical  DATE/TIME  STAMP:  10-06-97  20:02:51 
EVENT  SEQ.  NUMBER:  571  EVENT  TYPE:  5  CSC  ID:  3.02 

Status  of  the  AWOS  connection  has  changed. 

AWOS  station  id:  K005  controller:  1 
channel :  2 

Link  Status:  link  down  Event:  link  down 
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EVENT  PRIORITY:  non-critical  DATE/TIME  STAMP:  10-06-97  20:02:51 
EVENT  SEQ.  NUMBER:  572  EVENT  TYPE:  5  CSC  ID:  3.02 

Status  of  the  AWOS  connection  has  changed. 

AWOS  station  id:  K006  controller:  1 
channel:  2 

Link  Status:  link  down  Event:  link  down 


EVENT  PRIORITY:  non-critical  DATE/TIME  STAMP:  10-06  97  20:02:51 
EVENT  SEQ.  NUMBER:  573  EVENT  TYPE:  5  CSC  ID:  3.02 

Status  of  the  AWOS  connection  has  changed. 

AWOS  station  id:  K007  controller:  1 
channel :  2 

Link  Status:  link  down  Event:  link  down 
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C.4.10  TEST  IN-12E  -  WMSCR  Interface 


The  following  paragraphs  provide  information  about  data  associated  with  this 
test  but  not  included  within  the  main  body  of  this  report. 


C.4.10.1  Associated  Evaluation  Criteria  and  Data 

The  following  Evaluation  Criteria  were  used  to  determine  the  requirements 
passed/failed.  The  Cross  Reference  (CR)  numbers  can  be  used  to  trace  into  the 
data  found/referenced  below. 

Pass  Fail 

[  ]  Each  test  procedure  step's  "pass"  box,  in  the  'Observed 

Results'  column,  is  marked,  indicating  the  'Expected 
Response'  was  observed  and/or  the  correct  action  was 
performed  successfully.  (See  Appendix  C  for  the  test 
procedures  performed  for  this  test) . 

]  The  X.25  packet  switching  protocol  through  the  NADIN  II 
Network.  CR01  NAS-SS-1000  Volume  II,  Figure  3. 2. 1.5. 8. 3.1 
and  Table  '3.2.1 .5. 6. 3-lb,  'and'/ or  the  pertinent  NADIN  II 
User /ADAS  I CD. 

]  The  Transport  Layer,  Service  Class  4,  to  enable  ADAS 
Application  Processes  to  communicate  with  those  of  its  NADIN 

II  User.  CR02  NAS-SS-1000  Volume  II,  Figure . 3.2;1-5.8.3.1 

and  Table  "3"."2 . 076 3-lb'; . and/or . the . pertinent . NADIN . II 

User/ADAS  I CD. 


The  following  data,  marked  with  evaluation  criteria  cross-reference  numbers, 
is  a  subset  of  the  OT&E  formal  test  run  data.  Other  relavent  data  has  been 
included  into  test  IN-12Ers  Test  Conduct  Form  (TCF)  file,  IN-12E.TCF  . 

DATA  EXTRACTED  FROM  LMPA  FILE; 


a.  [xx] 


b.  [xx]  [ 


c.  [xx]  [ 


*M0N/DISK/FD1*  BLK=00050  03/18/98  18:18  Page  :  1  111! 


SRC 

LCN 

TYPE 

Pr 

Ps  QDM 

MISC 

SIZE 

BCC 

DTE 

028 

DATA 

5 

7 

0018 

[G] 

DTE 

028 

DATA 

5 

0 

0122 

[G] 

DTE 

028 

DATA 

5 

1 

0104 

[G] 

DTE 

028 

DATA 

5 

2 

0148 

[G] 

DCE 

028 

RR 

3 

0003 

[G] 
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DCE 

028 

DATA 

3 

5 

0008 

[G] 

DCE 

028 

DATA 

3 

6 

0008 

[G] 

DTE 

028 

DATA 

5 

3 

0219 

[G] 

DCE 

028 

DATA 

4 

7 

0008 

[G] 

DCE 

028 

CLEAR 

93F4 

0005 

[GJ 

DTE 

ill! 

028 

028 

CLEAR  C 

CALL 

AA001 304 120000 13 

0003 

0057 

[G] 

1113: 

DCE 

mil 

CALLACC 

02030Q2A420B0843 

000802CC42080843 

0013 

III 

DTE 

iiiti 

DATA 

CO  4  04 
0 

0 

0219J 

m 

mi 

028 

DATA 

Jr  ' 

0 

0008 

ill: 

1111 

028 

DATA 

i 

1  : 

..0008 

iii 

DTE 

•028 

DATA  JJ 

JJ:2  ::  J 

1 

0018 

in 

DTE 

028 

DATA 

2 

2 

0008 

JIG] 

DCE 

028 

DATA 

3 

2  :  V 

0008 

1®; 

pH 

028 

DATA 

3 

3 

0018 

(GJ 

|te 

.028 

DATA 

ll||;  || 

4 

0122 

hi: 

DTE 

028 

DATA 

3 

5 

0104 

ill 

DTE 

Hill 

DATA 

3 

6 

0148; 

ill 

DCE 

028 

RR 

7 

0003 

ill 

DCE 

026  | 

DATA 

7 

3 

0008 

ill 

DTE 

02  8 

DATA 

:  3 

7 

0219 

ill 

DCE 

028 

DATA 

7 

4 

0008 

ill 

DCS 

02  8 

DATA 

0 

0008 

III 

nil 

028 

DATA 

0 

6  J 

0008 

III 

DTE 

028 

RR 

7 

0003 

I:! 

nil 

11111 

DATA 

0 

7 

0008 

m 

DTE 

028 

DATA 

0 

0 

0018 

[G] 

DTE 

028 

DATA 

0 

1 

0008 

[G] 

DCE 

028 

DATA 

2 

0 

0008 

[G] 
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DTE 

028 

DATA 

1 

2 

0018 

[G] 

DTE 

028 

DATA 

1 

3 

0122 

[G] 

DCE 

028 

DATA 

4 

1 

0008 

[G] 

DTE 

028 

DATA 

1 

4 

0104 

[G] 

DTE 

028 

DATA 

2 

5 

0148 

[G] 

DCE 

028 

DATA 

5 

2 

0008 

[G] 

*MON/DISK/ FD1*  BLK= 

00054 

03/18/98 

18:21  Page 

:  1 

SRC 

LCN 

TYPE 

Pr 

Ps  QDM 

MISC 

SIZE 

BCC 

DTE 

028 

DATA 

2 

6 

0219 

[G] 

DCE 

028 

DATA 

7 

3 

0008 

[G] 

DCE 

02  8 

DATA 

7 

4 

0008 

[G] 

DCE 

028 

DATA 

7 

5 

0008 

[G] 

DTE 

028 

RR 

6 

0003 

[G] 

DTE 

028 

DATA 

6 

7 

0018 

[G] 

DCE 

028 

DATA 

0 

6 

0008 

[G] 

DTE 

028 

DATA 

7 

0 

0018 

[G] 

DTE 

028 

DATA 

7 

1 

0122 

[G] 

DCE 

028 

DATA 

2 

7 

0008 

[G] 

DTE 

028 

DATA 

0 

2 

0104 

[G] 

DCE 

028 

DATA 

3 

0 

0008 

[G] 

DTE 

028 

DATA 

0 

3 

0148 

[G] 

DTE 

028 

DATA 

0 

4 

0219 

[G] 

DCE 

028 

DATA 

5 

1 

0008 

[G] 

DCE 

028 

DATA 

5 

2 

0008 

EG] 

DTE 

028 

DATA 

3 

5 

0008 

[G] 

DCE 

028 

DATA 

6 

3 

0008 

EG] 

DTE 

028 

DATA 

4 

6 

0018 

EG] 

DCE 

028 

DATA 

7 

4 

0008 

EG] 
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DATA  EXTRACTED  FROM  IPS  FILE  AND  WMSCR  FILE:  (CR02) 
ADAS  AWOS  OUTPUT  MESSAGE/WMSCR  METAR  INPUT  MESSAGE 


OUTPUT  MESSAGE  #: 


444 


TRANSMIT  TIME  (IPS) : 
• : • TRANSMIT  TIME  {ADAS) 
TIME  OFFSET: 

STATION  ID:  .  .  . 

MESSAGE  TYPE: 

FILE  NAME: 

FIELD  NUMBER: 

FIELD  VALUE: 


03/16/98  18:17:00 
03/18/98  18:17500 
0 

12 

ADAS_AWOS_MSG 

aw_msg/std 

0 

FIELD  OFFSET: 

0 

0 

0 


FIELD  SIZE: 


OUTPUT  MESSAGE  #: 


459 


TRANSMIT  TIME  (IPS):  03/18/98  18:18:01 
TRANSMIT  TIME  (ADAS):  03/18/98  18:18:01 
TIME  OFFSET:  0 

STATION  ID: 

MESSAGE  TYPE: 


FILE  NAME: 
FIELD  NUMBER: 
FIELD  VALUE: 


12 

ADAS_AWOS_MSG 

aw_msg/std 

0 

FIELD  OFFSET: 

0 

0 

0 


FIELD  SIZE: 


ADAS  METAR  OUTPUT  MESSAGE/WMSCR  METAR  INPUT  MESSAGE 
OUTPUT  MESSAGE  #:  443 


MESSAGE  TYPE 
FILE  NAME: 
FIELD  NUMBER: 
FIELD  VALUE: 


ADAS_AWOS_MSG 

aw_msg/std 

0 

FIELD  OFFSET: 


FIELD  SIZE: 


0 
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0 


o  o  o 


0 

0 


1 

1 


0 

0 


OUTPUT  MESSAGE  #:  463 


UPf  (IPS): 
HI  x?m 

TIME  OFFSET: 


m 

\r  pMt*  t  W '%  S  i  i 
6 


MESSAGE  TYPE: 
FILE  NAME: 
FIELD  NUMBER: 
FIELD  VALUE: 


m 

ADAS_AWOS_MSG 

aw_msg/std 

0 

FIELD  OFFSET: 


0 

0 

0 


FIELD  SIZE: 

1  0 

1  0 

1  0 


ADAS  AWOS  OUTPUT  MESSAGE/WMSCR  METAR  INPUT  MESSAGE 


OUTPUT  MESSAGE  #:  446 


MESSAGE  TYPE: 
FILE  NAME: 
FIELD  NUMBER: 
FIELD  VALUE: 


ADAS_AWO  S_MS  G 
aw_msg/std 
0 

FIELD  OFFSET: 


0 

0 

0 


FIELD  SIZE: 

1 

1 

1 


OUTPUT  MESSAGE  #:  462 


MESSAGE  TYPE: 
FILE  NAME: 
FIELD  NUMBER: 
FIELD  VALUE: 


ADAS_AWOS_MSG 

aw_msg/std 

0 

FIELD  OFFSET: 


0 

0 

0 
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FIELD  SIZE: 

1 

1 

1 


o  o  o  o  o  o 


ADAS  SUMMARY  OUTPUT  MESSAGE/WMSCR  SUMMARY  INPUT  MESSAGE 


OUTPUT  MESSAGE  #:  106 


TRANSMIT  TIME  (IPS):  03/18/98  18; 18: 01 
TRANSMIT  TIME  (ADAS):  03/18/98  18:18:01 


TIME  OFFSET: 
STATION  ID: 
MESSAGE  TYPE: 
FILE  NAME: 
FIELD  NUMBER: 
FIELD  VALUE: 


0 

20 

ADAS_SUMMARY_MSG 

aw_summ/dlyl_std 

0 

FIELD  OFFSET: 

0 

0 

0 


OUTPUT  MESSAGE  #:  107 

TRANSMIT  TIME : :  ( IPS ) : 
TRANSMIT  TIME  (ADAS ) ; 

TIME  OFFSET: . 

STATION  ID: 


MESSAGE  TYPE: 
FILE  NAME: 
FIELD  NUMBER: 
FIELD  VALUE: 


OUTPUT  MESSAGE  #: 


03/18/98  18:18:01 
03/18/98  18:18:01 
6 

21 

ADAS_SUMMARY_MS  G 
aw_summ/dlyl_std 
0 

FIELD  OFFSET: 

0 

0 

0 

108 


TRANSMIT  TIME 
TRANSMIT  TIME 
TIME  OFFSET: 
STATION  ID: 
MESSAGE:  TYPE- 
FILE  NAME: 
FIELD  NUMBER: 
FIELD  VALUE: 


(IPS) :  03/18/98  18:18:02 

(ADAS):  03/18/98  18:18:02 
0 

22 

ADAS_SUMMARY_MSG 

aw_summ/dlyl_std 

0 

FIELD  OFFSET: 


0 

0 

0 


FIELD  SIZE: 

1 

1 

1 


0 

0 

0 


FIELD  SIZE: 

1 

1 

1 


0 

0 

0 


FIELD  SIZE: 

1 

1 

1 


o  o  o 


ADAS  SHEF  OUTPUT 


OUTPUT  MESSAGE  # 

TRANSMIT  TIME 
TRANSMIT  TIME 
'TIME  OFFSET: 
STATION  ID: 
MESSAGE  TYPE: 
FILE  NAME: 
FIELD  NUMBER: 
FIELD  VALUE: 


OUTPUT  MESSAGE  # 

TRANSMIT  TIME 
TRANSMIT  TIME 
TIME  OFFSET: 
STATION  ID: 
MESSAGE  TYPE: 
FILE  NAME: 
FIELD  NUMBER: 
FIELD  VALUE: 


OUTPUT  MESSAGE  # 

TRANSMIT  TIME 
TRANSMIT  TIME 
OFFSET: 
STATION  ID: 
MESSAGE  TYPE: 
FILE  NAME: 
FIELD  NUMBER: 
FIELD  VALUE: 


OUTPUT  MESSAGE 

TRANSMIT  TIME 
TRANSMIT  TIME 
TIME  OFFSET: 
STATION  ID: 
MESSAGE  TYPE: 
FILE  NAME: 
FIELD  NUMBER: 
FIELD  VALUE: 


MESSAGE/WMSCR  SHEF  INPUT  MESSAGE 


69 


{IPS) :  03/18/96  18:17:00 

(ADAS) :  03/18/98  18:17 : 00 
0 

18 

ADAS_SHEF_MSG 
aw_shef / shef l_std 
0 

FIELD  OFFSET: 

0 

0 

0 


FIELD  SIZE: 

1  0 

1  0 

1  0 


70 


(IPS) :  03/18/98  18:17:02 

{ADAS) :  03/18/98  18 : 17:32 
0 

19 

ADAS_SHEF_MSG 
aw_shef /shef 2_std 
0 

FIELD  OFFSET: 

0 

0 

0 


FIELD  SIZE: 


0 

0 

0 


:  71 

{IPS):  03/18/98  18:18:31 

(ADAS!:  03/18/98  18:18:01 

. 0 

.  18 

ADAS_SHEF_MSG 
aw_shef /shef l_std 
0 

FIELD  OFFSET: 

0 

0 

0 


FIELD  SIZE: 


72 


{IPS) :  03/18/98  18:18:02 

{ADAS  5 :  0  3/18 / 9  8  1 8 : 18 : 02 
0 

19 

ADAS_S  H  E  F_MS G 
aw_shef / shef 2_std 
0 

FIELD  OFFSET:  FIELD  SIZE: 

0  1  0 
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0 

0 


1 

1 


0 

0 


DATA  EXTRACTED  FROM  ADAS  FILE: 


1.  COMMUNICATION  CHARACTERISTICSt&kOl  I'lgW 


.  93-18-98  17  j  41s 35 

.  Events:  11  . 

Responses : 

0  . 

DATAPOINT  CMDS 

DISPLAY  If 

JLDN  COMMUNK 

NATIONS  LU 

DATAPOINTS 

ALERT 

ALARM 

DATAPOINT  NAME 

ID 

VALUE 

CURR  PAST 

CURR  PAST 

LAST  RESET 

CONNECTION  STATUS: 

oi  m 

"G-ACTIVE 

03-18-98 

17:26:32 

NLDN  FAILURES  TOTAL: 

02 

b 

03-18-98 

17:26:32 

ERROR  DETECTED: 

03 

0 

03-18-98 

17:26:32 

ERROR  DETECTED  TOTAL: 

04 

0 

03-18-98 

17:26:32 

.  03-18-98  17:41:49 

.  Events: 

13 

.  Responses : 

0  . 

DATAPOINT 

CMDS 

DISPLAY  WMSCR 

COMMUNICATIONS  LU 

DATAPOINTS 

ALERT 

ALARM 

DATAPOINT  NAME 

ID  VALUE 

CURR  PAST 

CURR  PAST 

LAST  RESET 

CONNECTION  STATUS: 

01  CFG-7 

KTIVI 

i 

03-18-98 

17:26:32 

METAR  MESSAGES  SENT: 

02 

0 

03-18-98 

17:26:32 

ADU  DATA  TRANSFERS: 

03 

0 

03-18-98 

17:26:32 

SHEF  MESSAGES  SENT: 

04 

0 

03-18-98 

17:26:32 

SHEF  MSG  DISCARDS: 

05 

0 

03-18-98 

17:26:32 

.03-18-98  17:42:07 

.  Events : 

18 

.  Responses: 

0  . 

DATAPOINT 

CMDS 

DISPLAY  ASfCS 

STATION  LU  DATAPOINTS 

ALERT  ALARM 

DATAPOINT 

NAME 

ID  VALUE 

CURR  PAST  CURR  PAST 

LAST  RESET 

CONNECTION 

STATUS : 

oi  finiMi 

:VE  03-18-98 

17:26:33 
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FRAMES  TRANSMITTED:  02 
FRAMES  RETRANSMITTED:  03 
FRAMES  NOT  DELIVERED:  04 
FRAMES  DELIVERED:  05 


2.  ADAS  EVENT  LOG:  (CR01  &  CRC2) 


48 

03-18-98 

17:26:33 

0 

03-18-98 

17:26:33 

0 

03-18-98 

17:26:33 

16 

03-18-98 

17:26:33 

EVENT  PRIORITY:  non-critical  DATE/TIME  STAMP:  03-18-98  17:26:28 
EVENT  SEQ.  NUMBER:  58  EVENT  TYPE:  5  CSC  ID:  3.02 

Status  of  the  AWOS  connection  has  changed. 

AWOS  station  id:  KSMI  controller:  1 
channel:  6 

Link  Status:  link  down  Event:  link  down 


EVENT  PRIORITY:  non-critical  DATE/TIME  STAMP:  03-18-98  17:42:12 
EVENT  SEQ.  NUMBER:  628  EVENT  TYPE:  5  CSC  ID:  3.02 

Status  of  the  AWOS  connection  has  changed. 

AWOS  station  id:  K013  controller :  1 

channel:  3 

link  Status:  up  Event:  link  reset 

EVENT  PRIORITY:  non-critical  DATE/TIME  STAMP:  03-18-98  17:42:12 
EVENT  SEQ.  NUMBER:  629  EVENT  TYPE:  5  CSC  ID:  3.02 

Status  of  the  AWOS  connection  has  changed. 

AWOS  station  id:  KOI 2  control le r :  1 
channel:  3 

Link  Status:  up  Event:  link  reset 

EVENT  PRIORITY:  non-critical  DATE/TIME  STAMP:  03-18-98  17:42:12 
EVENT  SEQ.  NUMBER:  630  EVENT  TYPE:  5  CSC  ID:  3.02 

Status  of  the  AWOS  connection  has  changed. 

AWOS  station  id:  K008  controller:  1 
channel :  2 

Link  Status:  up  Event:  link  reset 

EVENT  PRIORITY:  non-critical  DATE/TIME  STAMP:  03-18-98  17:42:12 
EVENT  SEQ.  NUMBER:  631  EVENT  TYPE:  5  CSC  ID:  3.02 

Status  of  the  AWOS  connection  has  changed. 

AWOS  station  id:  K009  controller:  1 

channel :  2 

Link  Status:  up  Event:  link  reset 

EVENT  PRIORITY:  non-critical  DATE/TIME  STAMP:  03-18-98  17:42:12 
EVENT  SEQ.  NUMBER:  632  EVENT  TYPE:  5  CSC  ID:  3.02 

Status  of  the  AWOS  connection  has  changed. 
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MOS  station  id:  K0I0  controller:  ! 

channel:  2 

•Link  Status':  up  Event:  link  reset 


EVENT  PRIORITY:  non-critical  DATE/TIME  STAMP:  03-18-98  17 f 42:12 
EVENT  SEQ.  NUMBER:  633  EVENT  TYPE:  5  CSC  ID:  3.02 

Status  of  the  AWOS  connection  has  changed. 

AWOS  station  id:  K011  controller:  1 
channel :  2 

Slink  Status:  up  Event:  link  reset 

EVENT  PRIORITY:  non-critical  DATE/TIME  STAMP:  03-18-98  17:42:13 
EVENT  SEQ.  NUMBER:  635  EVENT  TYPE:  5  CSC  ID:  3.02 

Status  of  the  AWOS  connection  has  changed. 

AWOS  station  id:  K001  controller:  1 
channel:  1 

Link  Status:  up  Event:  link  reset 

EVENT  PRIORITY:  non-critical  DATE/TIME  STAMP:  03-18-98  17:42:13 
EVENT  SEQ.  NUMBER:  636  EVENT  TYPE:  5  CSC  ID:  3.02 

Status  of  the  AWOS  connection  has  changed. 

AWOS  station  id:  K005  controller :  1 
channel :  2 

Link  Status:  up  Event:  link  reset 

EVENT  PRIORITY:  non-critical  DATE/TIME  STAMP:  03-18-98  17:42:13 
EVENT  SEQ.  NUMBER:  637  EVENT  TYPE:  5  CSC  ID:  3.02 

Status  of  the  AWOS  connection  has  changed. 

AWOS  station  id:  K002  controller:  1 

channel :  1 

Lihk  Status:  up  Event:  link  reset 


EVENT  PRIORITY:  non-critical  DATE/TIME  STAMP:  03-18-98  17:42:13 
EVENT  SEQ.  NUMBER:  638  EVENT  TYPE:  5  CSC  ID:  3.02 

Status  of  the  AWOS  connection  has  changed. 

AWOS  station  id:  K006  controller:  1 
channel:  2 

1111111111111  Event:  link  reset 


EVENT  PRIORITY:  non-critical  DATE/TIME  STAMP:  03-18-98  17:42:13 
EVENT  SEQ.  NUMBER:  639  EVENT  TYPE:  5  CSC  ID:  3. 02 

Status  of  the  AWOS  connection  has  changed. 

AWOS  station  id:  K003  controller:  1 
channel:  1 

Link  Status:  up  Event:  link  reset 
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EVENT  PRIORITY:  non-critical  DATE/TIME  STAMP:  03-18-98  17:42:13 
EVENT  SEQ.  NUMBER:  640  EVENT  TYPE:  5  CSC  ID:  3.02 

Status  of  the  AWOS  connection  has  changed. 

MOS  station  id:  K007  controller:  1 

channel :  2 

Link  Status:  up  Event:  link  reset 


EVENT  PRIORITY:  non-critical  DATE/TIME  STAMP:  03-18-98  17:42:13 
EVENT  SEQ.  NUMBER:  641  EVENT  TYPE:  5  CSC  ID:  3.02 

Status  of  the  AWOS  connection  has  changed. 

AWOS  station  id:  K004  controller:  1 

channel :  1 

kink  Status:  up  Event:  link  reset 

EVENT  PRIORITY:  non-critical  DATE/TIME  STAMP:  03-18-98  18:40:35 
EVENT  SEQ.  NUMBER:  1296  EVENT  TYPE:  5  CSC  ID:  3.02 

Status  of  the  AWOS  connection  has  changed. 


AWOS  station  id:  K005  controller:  1 
channel:  2 


Link  Status : 


disconnect 


Event:  link  disconnect 
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18.  gxsc  display:  Reset  the  IPS  test  time  offset.  The  IPS  test  time  offset  is  reset  to  0.  [x]Pass  [  ]  Fail  Stop  Test 

"  [  F8  ]  [FIX]  [SPACE]  [RETURN3  [F14]". 

19.  @AUC  'adas'  prompt:  enter  "cl  67  [RETURN]"  AUC  Displays:  Config  67  loaded  [x] Pass  [  ]Fail  Stop  Test 

20.  @AUC  'adas'  prompt:  enter  "cd  $1  [RETURN]"  Change  directory  to  the  ADAS  software  log.  [x]Pass  [  ]Fail  Stop  Test 
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C.5.  CATEGORY  IT  -  ITWS  Tests 


C.5.1.  TEST  IT-01  -  Channel  Connection  Test  FST  (ITWS) 

The  following  paragraphs  provide  information  about  data  associated  with  this 
test  but  not  included  within  the  main  body  of  this  report. 


C.5.1. 1.  Associated  Evaluation  Criteria  and  Data 

The  following  Evaluation  Criteria  were  used  to  determine  the  requirements 
passed/ failed .  The  Cross  Reference  (CR)  numbers  can  be  used  to  trace  into  the 
data  found/referenced  below. 


Pass  Fail 


[XX]  t  ]  Each  procedure  -step’s  "pass"  box,  in  the  'Observed  Results' 
column,  was  marked,  indicating  the  'Expected  Response'  was 
observed.  (See  Appendix  C  for  the  test  procedure  performed 
for  test  IT-01. ) 

(XX]  [  ]  The  retrieved  ADAS  Event  Log  must  show  that  ADAS 

successfully  detected  the  loss  of  connection  CR1  with  the  6 
ITWS  simulators  and  their  subsequent  re-connection  CR2 . 

[XX]  [  ]  The  Data  Reduction  Summary  of  the  DLP  AWOS  log  must  have 

indicated  that  each  mission  cycle,  the  DLP  receive  an  0M0 
for  each  of  the  5  AWOS  sites. 


d.  [XX]  [ 


e.  [XX]  [ 


f.  [XX]  [ 
the 


The  ITWS6  AWOS  message  log  must  have  shown  AWOS  format 
messages  (OMO's)  were  received  both  before  CR4A  and  after 
CR4B  the  ITWS ' s  communications  were  temporarily  disabled, 
and  the  total  number  of  OMO's  received  by  the  ITWS  CR4C 
should  be  5  less  [1  mission  cycle's  of  OMO's]  than  the  total 
number  of  OMO's  received  by  the  DLP  CR3 .  {ISS2-001). 

The  MPS  ALARM  log  must  have  indicated  detection  of 
communications  failure  on  all  6  ITWS's  CR5,  and  the  MPS 
RETURN  TO  NORMAL  log  must  have  indicated  detection  of 
communications  were  re-established  with  the  ITWS's  CR6 . 

The  LDD  message  logs  for  each  ITWS  must  have  shown  LDD 

messages  were  receive  both  before  CR7A  and  after  CR7B 
disabling  of  the  ITWS  communication.  (ISS2-001J. 


The  following  data,  marked  with  evaluation  criteria  cross-reference  numbers, 
is  a  subset  of  the  OT&E  formal  test  run  data.  Other  relavent  data  has  been 
included  into  IT-01 's  Test  Conduct  Form  (TCF)  file,  "IT-01. TCF". 
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EVENT  PRIORITY:  non- critical DATE/TIME  STAMP:  02-10-98  23: 22; 39 

EVENT^SEqV''''nUMBER :  262  EVENT  TYPE:  61 _ CSC  ID:  21.01 

Status  of  the  ITWS  connection  has  changed. 


site  id:  1002 

comm  status:  enabled- failed 

EVENT  PRIORITY :  non-critical  DAT E / T I ME  STAMP : 02- 1 0-98  2 3 : 2 2: 4 3 

EVENT  S E  Q .  NUMBE R :  2 63  EVENT  TYPE:  61 . CSC  ID:  21.01 

Status  of  the  lTWS  connect^q^haj^changed^ 

site  id:  1006 

comm  status:  enabled-failed 

EVENT  PRIORITY:  non-critical  DATE/TIME  STAMP:  02-10-98  23:22:46 

EVENT  SEQ.  NUMBER:  264  EVE  NT  TY  PE:  61 . CSC  ID:  21.01 

Stat usiofthei TWS  connection  has  changed. 

site  id:  1001 

comm  status:  enabled-failed 

EVENT  PRIORITY:  non-critical  DATE/TIME  STAMP:  02-10-98  23:22:49 

EVENT  SEQ.  NUMBER:  265  EVENT  TYPE:  61 . CSC  ID:  21.01 

Status- of  the  ITWS  connectionhaschanged . 

site  id:  1003 

comm  status:  enabled-failed 

EVENT  PRIORITY:  non-critical . .  :  02-10-98  23:22:53 

EVENT" SEQ ^.  NUMBER:  266  EVENT  TYPE:  61 _ CSC  ID:  21.01 

Status  of  the  ITWS  connection  has  changed. 


site  id:  1004 

comm  status:  enabled-failed 

EVENT  PRIORITY:  non-critical  DATE/TIME  STAMP: 

F.VF.NT ^SEQ'r'm^  ID:  21.01 

Status "  of  thi 'ITWS"  connection  has  changed. 


site  id:  1005 

comm  status:  enabled-failed . . . . . 

EVENT  PRIORITY:  non-critical  DATE/TIME  STAMP:  02-10-98  23:23:41 

EVENT  SEQ.  NUMBER :  282  EVENT  TYPE:  61 .  CSC  ID:  21.01 

Status  of  the  ITWS  connection  has  changed. 

site  id:  1005 

comm  status:  enabled-active 

EVENT  PRIORITY:  non-critical _ DATE/TIME  STAMP:  02-10-98  23:23:42 

EVENT  SEQ .  NUMBER:  283  EVENT  TYPE:  61 _ CSC  ID:  21.01 

Status  of  the  ITWS  connection__has_._£hanged^ 

site  id:  1006 

comm  status:  enabled-active 


EVENT  PRIORITY:  non-critical  DATE/TIME  STAMP:  02-10-98  23:23:44 
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EVENT  SEQ.  NUMBER:  284 . EVENT  TYPE:  61  CSC  ID:  21.01 

ITWS  connection  has  changed. 

site  id:  1001 

. comm  status :  enabled-active 

EVENT  PRIORITY:  non-critical  DATE/TIME  STAMP:  02-10-98  23:23:48 

EVENT  SEQ.  NUMBER:  285  EVENT  TYPE:  61  CSC  ID:  21.01 - 

ITWS  connection  has  changed. 

site  id:  1003 

comm  status:  enabled-active 


EVENT  PRIORITY:  non-critical  DATE/TIME  STAMP:  02-10-98  23:23:51 

EVENT  SEQ  ■  NUMBER:  '286 . 'EVENT 'TYPE  . CSC""idV'-'21"."oI . 

Status  of  the  ^TWS  connection  has  changed. 

site  id:  1004 

comm  status:  enabled-active 


5y®.NT..PRIORITY:mnon-critical  DATE/TIME  STAMP:  02-10-98  23:23:52 

EVENT  SEQ .  'nUMBER:'""287 . "j^TlT.yPET"61 . ■"'csc''jD:"'“21;'or . 

Status  of  the  ITWS  connection  has  changed. 


site  id:  1002 

comm  status:  enabled-active 


##  New  ADU  ##  INPUT  MESSAGE  #:  7 

ADU#:  7  |  (IPS):  02/10/98  23:26:02  -  (ADAS):  02/10/98  23:26:02  |  msgs  5 
Hdr:  Sim-2  |  ADU  size:  347  |  Type:  DLP  Awos  |  OMO's  =  5 
K003  K004  K001  K005  K002 


.'?°!f.§.i....?it.e ...Reports  Processed  =35 
Total  number  of  sites  . _■■■-- 

Site  ID  #  of  msgs  (6  per  line) 

ROOI  ~  1 . K002  ~  7  K003  -  7  K004  -  7  K005  -  7 

##  New  ADU  ##  INPUT  MESSAGE  #:  1 

MU# ;  .  1.  J . (IPS):  627lQ?Sr8~23:20Tl4  -  (ADAS)  :  02/1 0/98  23:20:14  |  msgs  5 

Hdr: Sim- 11  |  ADU  size:  392  j  Type:  ITWS6  Awos  | ID: 'kACY T”0M0ts"=  '6x05 
K003  K004  K001  k602  k005 . . . 

##  New  ADU  ##  INPUT  MES SAGE  #:  2 

Mfe.L4..i.JiPSrr027T0798--2372l:12  -  (ADAS)  :  02/10/98  23:21:12  j  msgs  5 

Hdr:  Sim-11  |  ADU  size:  392  j  Type:  ITWS 6  Awos" '"j . ID:'" ^'i^CY'  OMOvs''  =  0x6 5 

K001  K002  K005  K003  K004  ~  ~~  ~  — — - 


##  New  ADU  ##  INPUT  MESSAGE  #:  3 

ADU#:  3  j  ( IPS)'  :62/10/98  23:22:l  1  ~  (ADAS):  02/10/98  23:22:11  |  msgs  5 
Hdr:  Sim- 11  |  ADU  size:  392  |  Type:  ITWS6  Awos  |  ID:  KACY  I  OMO's  =  0x05 
K003  K004  K005  K001  K002  - ~ 


##  New  ADU  ##  INPUT  MESSAGE  #:  4 

. (IPS)  :  02/10/98  23:24:11  - . (.ADAS)  :  02/10/98  23:24:11  |  msgs  5 

Hdr:  Sim-11  |  ADU  size:  392  |  Type:  ITWS 6  Awos . f  ID:KACY  j  OMO ' s  =  6x05 

K005  K003  K 0 6 4  K001  K002 . . . 
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##  New  ADU  ##  INPUT  MESSAGE  #:  5 

ADU# :  5  ] . ( I PS ):0 2 7 1 0  / 9 8  2 3 : 25 :  1 1  -  ( ADAS )  :_  0 2 / 1 0 /98  23:25:11  [  msgs  5 

Hdr:  Sim-11  1  ADU  size  : . 392"'  I  "  Type:'"  ITWS6  Awos  |  ID:  KACY  ]  OMO's  =  0x05 

K001  K002  K005  K003  K004 

##  New  ADU  ##  INPUT  MESSAGE  #:  6 

ADU#:  6  |  (IPS):  02/ 10/98  23: 26:11  -  (ADAS):  02/10/98  23:26:11  1  msgs 5 
Hdr :  Sim-lT  f ~ADU  size :  392  |  Type:  ITWS6  Awos  |  ID:  KACY  |  OMO's  =  0x05 

”K003'"kM4"W6T”kM5”'kOO2 . : . . . . . . . . . 


Total  Site  Reports  Processed  =  30 


Total 

number  of  sites 

=  5 

Site 

ID  #  of  msgs  ( 

6  per  line) 

K001  -  6  K002  -  6  K003  -  6 K004  -  6 . K005  -  6 

INPUT  MESSAGE  #:  1 

RECEIVE  TIME  (IPS): 02/10/98  23:23:03 


RECEIVE  TIME  (ADAS) : 

02/10/98  23:23:03 

SIMULATOR  ID: 

3 

MESSAGE  TYPE: 

MPS  ALARM 

MESSAGE  SIZE: 

21 

GROUP  ID: 

o 

MESSAGE  TYPE:  MPS 

Alarm 

0x2e 

RMS  ID: 

0x01 

LOGICAL  UNIT  ID: 

DELIMITER: 

0x00 

MESSAGE  FUNCTION: 

41 

DATE: 

02/10/98 

TIME: 

23:23:04 

DATAPOINT  ID: 

0x01 

CONDITION  STATUS: 

0x42 

. DATA  TYPE: 

0x01 

RESOLUTION: 

0x00 

PARAMETER  VALUE: 

(001) 

Decimal 

(01) 

Hex 

(  ) 

Ascii 

INPUT  MESSAGE  #: 

2 

RECEIVE  TIME  (IPS) 

:  02/10/98  23:23:03 

RECEIVE  TIME  (ADAS):  02/10/98  23:23:03 

SIMULATOR  ID: 

3 

MESSAGE  TYPE: 

MPS  ALARM 

MESSAGE  SIZE: 

21 

GROUP  ID: 

0 

MESSAGE  TYPE:  MPS 

Alarm 

0x2f 

RMS  ID: 

0x01 

LOGICAL  UNIT  ID: 

DELIMITER: 

0x00 

MESSAGE  FUNCTION: 

41 

DATE: 

02/10/98 

TIME: 

23:23:05 

DATAPOINT  ID: 

0x01 

CONDITION  STATUS: 

0x42 

DATA  TYPE: 

0x01 

RESOLUTION : 

0x00 

PARAMETER  VALUE: 

(001) 

Decimal 

(01) 

Hex 

(  ) 

Ascii 

INPUT  MESSAGE  #: 

3 

RECEIVE  TIME  (IPS) : 

02/10/98  23:23:03 
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RECEIVE  TIME  (ADAS):  02/10/9823:23:03 

SIMULATOR  ID :  . . . 3"™“" . 

MESSAGE  TYPE: _ MPS  ALARM 

MESSAGE  SIZE:  2l'“ 

.group  id"-  ;  ;  0 

MsSAGE'"TYM:'''MPS"Marm . “ 

RMS  ID:  _ .  . 0x01  LOGICAL  UNIT  ID:  0x30 

DELIMITER: . . 0x00 _ MESSAGE  FUNCTION:  41 


DATE: . . .  0.2/10/98  TIME-: . . . " . 23:23:05 


DATAPOINT  ID: . 6x01  CONDITION  STATUS :: . 0x42' 


DATA  TYPE: _ 0x01 . RESOLUTION":  0x00 


PARAMETER  VALUE:  ‘  ( 0*01)  Decimal 

.  (01)  ~Hex 

. (  j Ascii 

INPUT  MESSAGE  #^_  4 

. RECEIVE  TIME  (IPS) :  02/10/98  23:23:03 

RECEIVE  TIME  (ADAS)  ”: . 027T6798 "23 : 23:03 

SIMULATOR-  ID;  _ 3  "  ~ 

MESSAGE  TYPE:  MPS  ALARM 

MESSAGE  “SIZE: . . . . . 2f" 

. GROUP  ID: . . . . . .  0 

_ MESSAGE  TYPE:  MP S  Alarm 

. RMS  ID: .  0x01  LOGICAL  UNIT  ID:  0x31 


DELIMITER  : . .  . 0x00 . MESSAGE  "FUNCTION 


DATE: . . 02/10/98  TIME  ; ‘ . 23723:  05 


DATAPOINT  ID: _  0x01  CONDITION  STATUS:  0x42 


DATA  TYPE : . . . 0x01  RESOLUT ION:  0x00 


. PARAMETER  VALUE:  . {001)' . Decimal 

. . ;’0l") . Hex . 

_ _ _ _ ( . ) _ Ascii 

INPUT  MESSAGE  #:  5 


RECEIVE  TIME 
RECEIVE  TIME 

(IPS)  : 
(ADAS)  : 

02/10/98  23:23:03 
02/10/98  23:23:03 

SIMULATOR  ID: 

3 

MESSAGE  TYPE: 

MPS  ALARM 

MESSAGE  SIZE: 

21 

GROUP  ID: 

6 

. MESSAGE  TYPE:  MPS "Alarm . 

_ RMS  ID: . . 0x01 LOGICAL  UNIT  ID:  0x32 

DELIMITER: _ 0x00  MESSAGE  "FUNCTION:  "  41 

. PATE: . . 02/10/98  TIME:  23:23:05 

DATAPOINT  ID: . " 0x01 . CONDITIOF  STATUS: . 0x42 

DATA  TYPE: . . 0x01 . RESOLUTION: . 6x00 

PARAMETER  VALUE:  (001)  Decimal 

. . .  (Oil  Hex . 

. . (  )  Ascii 

INPUT  MESSAGE  #:  6 


RECEIVE  TIME  (IPS) :  02/10/98  23:23:05 

RECEIVE  TIME  (ADAS  j": . 02 / 1 6/9  8" "" 2 3  :  2 3  7 0 5 

SIMULATOR  ID£_  3 

MESSAGE  TYPE:  . MPS"’ ALARM 

MESSAGE  SIZE: . 2 1 " " 
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0 


GROUP  ID: 


MESSAGE  TYPE:  MPS  Alarm 

RMS  ID: . . . Ox 0 1  LOGICAL  UNIT  ID: _ 0x33 


DELIMITER: 

0x00  MESSAGE  FUNCTION: 

41 

DATE: 

02/10/98  TIME: 

23:23:05 

DATAPOINT  ID: 

0x01  CONDITION  STATUS: 

0x42 

DATA  TYPE: 

0x01  RESOLUTION: 

0x00 

PARAMETER  VALUE: 

(001)  Decimal 

(01)  Hex 

(  )  Ascii 

INPUT  MESSAGE  #: 

1 

RECEIVE  TIME  (IPS):  02/10/98  23:24:03 

RECEIVE  TIME  (ADAS):  02/10/98  23:24:03 

SIMULATOR  ID:  3 

MESSAGE  TYPE:  MPS_RTN_NORMAL 

MESSAGE  SIZE:  21 

GROUP  ID:  0 

MESSAGE  TYPE:  MPS  Return  to  Normal 

RMS  ID: 

0x01  LOGICAL  UNIT  ID: 

0x2e 

DELIMITER: 

0x00  MESSAGE  FUNCTION: 

42 

DATE: 

02/10/98  TIME: 

23:24:05 

DATAPOINT  ID: 

0x01  CONDITION  STATUS: 

0x40 

DATA  TYPE: 

0x01  RESOLUTION: 

0x00 

PARAMETER  VALUE: 

(002)  Decimal 

(02)  Hex 

(  )  Ascii 

INPUT  MESSAGE  #: 

2 

RECEIVE  TIME  (IPS) 

:  02/10/98  23:24:04 

RECEIVE  TIME  (ADAS 

) :  02/10/98  23:24:04 

SIMULATOR  ID: 

3 

MESSAGE  TYPE: 

MPS  RTN  NORMAL 

MESSAGE  SIZE: 

21 

GROUP  ID: 

0 

MESSAGE  TYPE:  MPS 

Return  to  Normal 

RMS  ID: 

0x01  LOGICAL  UNIT  ID: 

0x2  f 

DELIMITER: 

0x00  MESSAGE  FUNCTION: 

42 

DATE: 

02/10/98  TIME: 

23:24:05 

DATAPOINT  ID: 

0x01  CONDITION  STATUS: 

0x40 

0x00 

PARAMETER  VALUE: 

(002)  Decimal 

(02)  Hex 

(  )  Ascii 

INPUT  MESSAGE  #: 

3 

RECEIVE  TIME  (IPS) 

:  02/10/98  23:24:04 

RECEIVE  TIME  (ADAS):  02/10/98  23:24:04 

SIMULATOR  ID: 

3 

MESSAGE  TYPE: 

MPS  RTN  NORMAL 

MESSAGE  SIZE: 

21 

GROUP  ID: 

0 

MESSAGE  TYPE:  MPS 

Return  to  Normal 

RMS  ID: 

0x01  LOGICAL  UNIT  ID: 

0x30 

DELIMITER: 

0x00  MESSAGE  FUNCTION: 

42 
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DATE: . . 02/10/98  TIME:  23:24:05 


DATAPOINT  ID: 

0x01 

CONDITION  STATUS: 

0x40 

DATA  TYPE: 

0x01 

RESOLUTION: 

0x00 

PARAMETER  VALUE: 

(002) 

Decimai 

(02) 

Hex 

(  ) 

Ascii 

INPUT  MESSAGE  # 

: _ 

4 

RECEIVE  TIME 

(IPS)  : 

:  02/10/98  23:24:04 

RECEIVE  TIME 

(ADAS ) 

:  02/16/98  23:24:04 

SIMULATOR  ID: 

3 

MESSAGE  TYPE: 

MPS 

RTN  NORMAL 

MESSAGE  SIZE: 

21 

GROUP  ID: 

0 

MESSAGE  TYPE: 

MPS  Return  to  Normal 

RMS  ID: 

0x01 

LOGICAL  UNIT  ID: 

0x31 

DELIMITER: 

0x00 

MESSAGE  FUNCTION: 

42 

DATE: 

02/10/98  TIME: 

23:24:05 

DATAPOINT  ID: 

0x01 

CONDITION  STATUS: 

0x40 

DATA  TYPE: 

0x01 

RESOLUTION: 

0x00 

PARAMETER  VALUE: 

(002) 

Decimal 

(02) 

Hex' 

(  ) 

Ascii 

INPUT  MESSAGE  # 

: 

5 

RECEIVE  TIME 

(IPS)  : 

02/10/98  23:24:04 

RECEIVE  TIME 

(ADAS ) 

:  02/10/98  23:24:04 

SIMULATOR  ID: 

3 

MESSAGE  TYPE: 

MPS 

RTN  NORMAL 

MESSAGE  SIZE: 

21 

GROUP  ID: 

0 

MESSAGE  TYPE: 

MPS  Return  tc 

i  Normal 

RMS  ID: 

0x01 

LOGICAL  UNIT  ID: 

0x32 

DELIMITER: 

0x00 

MESSAGE  FUNCTION: 

42 

DATE: 

02/10/98 

TIME: 

23:24:05 

DATAPOINT  ID: 

0x01 

CONDITION  STATUS: 

0x40 

DATA  TYPE: 

0x01 

RESOLUTION: 

0x00 

PARAMETER  VALUE: 

(002) 

Decimal 

(02) 

Hex 

(  ) 

Ascii 

INPUT  MESSAGE  # 

6 

RECEIVE  TIME 

(IPS) : 

02/10/98  23:24:05 

RECEIVE  TIME 

(ADAS) 

:  02/10/98  23:24:05 

SIMULATOR  ID: 

3 

MESSAGE  TYPE: 

MPS 

RTN  NORMAL 

MESSAGE  SIZE: 

21 

GROUP  ID: 

0 

MESSAGE  TYPE: 

MPS  Return  to 

Normal 

RMS  ID: 

0x01 

LOGICAL  UNIT  ID: 

0x33 

DELIMITER: 

0x00 

MESSAGE  FUNCTION: 

42 

DATE: 

02/10/98 

TIME : 

23:24:05 

DATAPOINT  ID: 

0x01 

CONDITION  STATUS: 

0x40 

DATA  TYPE: 

0x01 

RESOLUTION: 

0x00 

PARAMETER  VALUE: 

(002) 

Decimal 
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(02) Hex 
(  )  Ascii 


#####FILE:  /us r/ip s/aldars/tst/IT- 01/IT- 01E. I6LDD  #  Feb  10  @  23:33:20 
-rw-rw-r —  1  aldars  adasteam  17642  Feb  10  23:30  IT-01E.I6LDD 

#####START  of  file  framing  line  ##### 

INPUT  MESSAGE  LOG  -  TEST  ID:  IT-01  VERS:  1 

INPUT  MESSAGE  # :  1  RECEIVE  ( I 02/ 10/ 98  23 : :  19 : 15 . (ADAS): . .02/10/98 

23:19:15 . 

I N'FuT '''’MESSAGE  #  2  RECEIVE _ (IPS)  ; _ 02/10/98 . 23:19:21  (ADAS)  : _ 02/10/98 

INPUT  MESSAGE  # :  3  RECEIVE  (IPS)': . 02/10/98 . 23:19:27 . (.ADAS)  : . 02/10/98 

INPUT . MESSAGE  #:  4 _ RECEIVE  (IPS):  02/10/98  23:19:33  (ADAS): — 02/10/98 

INPOT  "MESSAGE  # :  5  RECEIVE  (IPS): . 02/10/98 . 23:19:38 . (ADAS J )  :  02  / 1.0/98 

23:19:38 

INPUT  MESSAGE  #:  6  RECEIVE  (IPS):  02/10/98  23:19:44  (ADAS): _ 02/10/98 

23 : 19:44 

INPUT  MESSAGE  # :  7  RECEIVE  (IPS).: . 02/10/98 . 23:19:49 . (ADAS)  : . 02/10/98 

23:  19:49 . 

INPUT  MESSAGE  #:  8  RECEIVE  (IPS):  02/10/98  23:19:55  (ADAS): — 02/10/98 

Mfuf"" 'MESSAGE  # :  9  RECEIVE  (IPS): . 02/10/98 . 23:20:01 . (ABA?.!.! . 

23:20:01  .  . 

INpuf  "'MESSAGE  # :  10  RECEIVE  (IPS):  02/10/98  23:20:05  (ADAS): _ 0.2/10/98 

23*20*05 

INPUT  MESSAGE  # :  11  RECEIVE  ( IPS )  : . 02 / 10/ 98  23:  20 :  1.3. . (ADA? )  : . ,02/1.0/98 

23:20:13 . 

INPUT  MESSAGE  #:  12  RECEIVE  (IPS):  02/10/98  23:20:18  (ADAS): _ 02/10/98 

23 • 20 *18 

IN^UT ""MESSAGE  #:  13  RECEIVE  (IPS)  :  02/10/98 . 23:20:25 . (ADAS.)  :  02/10/98 

23:20:25 . 

INPUT  "MESSAGE  # :  14  RECEIVE  (IPS):  02/10/98  23:20:29  (ADAS): _ 02/10/98 

23*20*29 

INPUT  MESSAGE  # :  15  RECEIVE  (IPS).: . 02/ 10/ 9 8 ..... 23 ..: 20: 34 . ( ADAS ) ...: . 02/10/98 

23 : 20  5  34 . 

INPUT  MESSAGE  #:  16  RECEIVE  (IPS):  02/10/98  23:20:40  (ADAS): _ 02/10/98 

23 : 20 : 40 

INPUT  MESSAGE  #:  17  RECEIVE  (IPS.).: . 02/10/98 . 23:20:45 . ( ADAS.)  i . .02/10/98 

23:20:45 . 

INPUT  "MESSAGE  # :  18  RECEIVE  (IPS):  02/10/98  23:20:51 . __(ADAS)j _ 02/10/_9J 

23:20 :  5 1" . 

INPUT  MES  SAGE  #:  19  RECEIVE  (IPS): . 02/10/98 . 23:20:56 . (ADAS!..! . 0.2/1.0/98 

23:20 : 5  6 . 

INPUT  MESSAGE  #:  20  RECEIVE  (IPS):  02/10/98  23:21:03  (ADAS):  02/10/98 

23:21: 03 

I N  PUT  ""MESSAGE  #  :  21  RECEIVE  (IPS)  :  0.2/ 1.0/ 9  8 . 23 : 2 1:0 ^9 . ..(ADAS)  : . P.2./1.0/98 

23:21:09 . . 

INPUT  MESSAGE  #:  22  RECEIVE  (IPS)  : _ 02/10/98 _ 23:21:11  (ADAS)  : _ 02/10/98 

23:21:11 

INPUT  MESSAGE  # :  23  RECEIVE  (IPS):  02/10/98 . 23:21:16 . (ADAS.)...! . 

23:21:16 . : .  . 

INPUT*  MES  SAGE  #:  24  RECEIVE  (IPS):  02/10/98  23:21:22  (ADAS):  02/10/98 

23:21:22 

INPUT  MESSAGE  # :  25  RECEIVE  (IPS)  :  02/10/98 . 23:21:27 . (ADAS)  : . .P.2/1.0/98 

23:21:27 . ■ . . . . '' . . 
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INPUT  MESSAGE 

#: 

26 

RECEIVE 

(IPS) : 

02/10/98 

23:21:34 

(ADAS)  : 

02/10/98 

23:21:34 

INPUT  MESSAGE 

#: 

27 

RECEIVE 

(IPS) : 

02/10/98 

23:21:38 

(ADAS )  : 

02/10/98 

23:21:38 

INPUT  MESSAGE 

# : 

28 

RECEIVE 

(IPS) : 

02/10/98 

23:21:44 

(ADAS)  : 

02/10/98 

23:21:44 

INPUT  MESSAGE 

# : 

29 

RECEIVE 

(IPS) : 

02/10/98 

23:21:48 

(ADAS)  : 

02/10/98 

23:21:48 

INPUT  MESSAGE 

# : 

30 

RECEIVE 

(IPS) : 

02/10/98 

23:21:54 

(ADAS)  : 

02/10/98 

23:21:54 

INPUT  MESSAGE 

# : 

31 

RECEIVE 

(IPS) : 

02/10/98 

23:22:00 

(ADAS)  : 

02/10/98 

23:22:00 

INPUT  MESSAGE 

# : 

32 

RECEIVE 

(IPS) : 

02/10/98 

23:22:05 

(ADAS)  : 

02/10/98 

23:22:05 

INPUT  MESSAGE 

# : 

33 

RECEIVE 

(IPS) : 

02/10/98 

23:22:11 

(ADAS)  : 

02/10/98 

23:22:11 

INPUT  MESSAGE 

# : 

34 

RECEIVE 

(IPS) : 

02/10/98 

23:22:17 

(ADAS)  : 

02/10/98 

23:22:17 

INPUT  MESSAGE 

35 

RECEIVE 

(IPS) : 

02/10/98 

23:22:22 

(ADAS)  : 

02/10/98 

23:22:22 

INPUT  MESSAGE 

#: 

36 

RECEIVE 

(IPS) : 

02/10/98 

23:22:28 

(ADAS)  : 

02/10/98 

23:22:28  . 

INPUT  MESSAGE 

# : 

37 

RECEIVE 

(IPS) : 

02/10/98 

23:23:46 

(ADAS)  : 

02/10/98 

23:23:46 

INPUT  MESSAGE 

#: 

38 

RECEIVE 

(IPS)  : 

02/10/98 

23:23:50 

(ADAS )  : 

02/10/98 

23:23:50 

INPUT  MESSAGE 

#: 

39 

RECEIVE 

(IPS) : 

02/10/98 

23:23:56 

(ADAS)  : 

02/10/98 

23:23:56 

INPUT  MESSAGE 

# : 

40 

RECEIVE 

(IPS)  : 

02/10/98 

23:24:02 

(ADAS)  : 

02/10/98 

23:24:02 

INPUT  MESSAGE 

# : 

41 

RECEIVE 

(IPS) : 

02/10/98 

23:24:08 

(ADAS)  : 

02/10/98 

23:24:08 

INPUT  MESSAGE 

#: 

42 

RECEIVE 

(IPS) : 

02/10/98 

23:24:11 

(ADAS)  : 

02/10/98 

23:24:11 

INPUT  MESSAGE 

# : 

43 

RECEIVE 

(IPS)  : 

02/10/98 

23:24:16 

(ADAS)  : 

02/10/98 

23:24:16 

INPUT  MESSAGE 

# : 

44 

RECEIVE 

(IPS)  : 

02/10/98 

23:24:22 

(ADAS )  : 

02/10/98 

23:24:22 

INPUT  'MESSAGE 

# : 

45 

RECEIVE 

(IPS) : 

02/10/98 

23:24:27 

(ADAS)  : 

02/10/98 

23:24:27 

INPUT  MESSAGE 

# : 

46 

RECEIVE 

(IPS)  : 

02/10/98 

23:24:33 

(ADAS)  : 

02/10/98 

23:24:33 

INPUT  MESSAGE 

# : 

47 

RECEIVE 

(IPS)  : 

02/10/98 

23:24:39 

(ADAS)  : 

02/10/98 

23:24:39 

INPUT  MESSAGE 

#: 

48 

RECEIVE 

(IPS)': 

02/10/98 

23:24:44 

(ADAS)  : 

02/10/98 

23:24:44 

INPUT  MESSAGE 

# : 

49 

RECEIVE 

(IPS)  : 

02/10/98 

23:24:50 

(ADAS)  : 

02/10/98 

23:24:50 

INPUT  MESSAGE 

#: 

50 

RECEIVE 

(IPS)  : 

02/10/98 

23:24:55 

(ADAS)  : 

02/10/98 

23:24:55 

INPUT  MESSAGE 

# : 

51 

RECEIVE 

(IPS)  : 

02/10/98 

23:25:01 

(ADAS)  : 

02/10/98 

23:25:01 

INPUT  MESSAGE 

# : 

52 

RECEIVE 

(IPS!  : 

02/10/98 

23:25:08 

(ADAS)  : 

02/10/98 

23:25:08 

INPUT  MESSAGE 

# : 

53 

RECEIVE 

(IPS)  : 

02/10/98 

23:25:10 

(ADAS)  : 

02/10/98 

23:25:10  . . . 
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INPUT  MESSAGE 

# : 

54 

RECEIVE 

(IPS) : 

02/10/98 

23:25:16 

(ADAS)  : 

02/10/98 

23:25:16 

INPUT  MESSAGE 

# : 

55 

RECEIVE 

(IPS) : 

02/10/98 

23:25:20 

(ADAS )  : 

02/10/98 

23:25:20 

INPUT  MESSAGE 

# : 

56 

RECEIVE 

(IPS)  : 

02/10/98 

23:25:26 

(ADAS)  : 

02/10/98 

23:25:26 

INPUT  MESSAGE 

# : 

57 

RECEIVE 

(IPS) : 

02/10/98 

23:25:31 

(ADAS)  : 

02/10/98 

23:25:31 

INPUT  MESSAGE 

#: 

58 

RECEIVE 

(IPS) : 

02/10/98 

23:25:38 

(ADAS)  : 

02/10/98 

23:25:38 

INPUT  MESSAGE 

#: 

59 

RECEIVE 

(IPS) : 

02/10/98 

23:25:43 

(ADAS)  : 

02/10/98 

23:25:43 

INPUT  MESSAGE 

# : 

60 

RECEIVE 

(IPS)  : 

02/10/98 

23:25:49 

(ADAS)  : 

02/10/98 

23:25:49 

INPUT  MESSAGE 

# : 

61 

RECEIVE 

(IPS) : 

02/10/98 

23:25:55 

(ADAS )  : 

02/10/98 

23:25:55 

INPUT  MESSAGE 

# : 

62 

RECEIVE 

(IPS) : 

02/10/98 

23:26:00 

(ADAS)  : 

02/10/98 

23:26:00 

INPUT  MESSAGE 

# : 

63 

RECEIVE 

(IPS) : 

02/10/98 

23:26:06 

(ADAS)  : 

02/10/98 

23:26:06 

INPUT  MESSAGE 

# : 

64 

RECEIVE 

(IPS) : 

02/10/98 

23:26:10 

(ADAS )  : 

02/10/98 

23:26:10 

INPUT  MESSAGE 

# : 

65 

RECEIVE 

(IPS) : 

02/10/98 

23:26:16 

(ADAS)  : 

02/10/98 

23:26:16 

INPUT  MESSAGE 

# : 

66 

RECEIVE 

(IPS)  : 

02/10/98 

23:26:21 

(ADAS )  : 

02/10/98 

23:26:21 

INPUT  MESSAGE 

# : 

67 

RECEIVE 

(IPS)  : 

02/10/98 

23:26:27 

(ADAS )  : 

02/10/98 

23:26:27 

INPUT  MESSAGE 

# : 

68 

RECEIVE 

(IPS)  : 

02/10/98 

23:26:32 

(ADAS)  : 

02/10/98 

23:26:32 

INPUT  MESSAGE 

#: 

69 

RECEIVE 

(IPS)  : 

02/10/98 

23:26:39 

(ADAS) : 

02/10/98 

23:26:39 
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C.5.1.2.  TCF  Test  Procedure  Steps 

The  following  test  procedure  steps,  referenced  by  evaluation  criteria  "a"  of  this  test's  'Data  Reduction  and  Analysis  Method' 
paragraph  m  the  main  body  of  this  report,  were  extracted  from  test  procedure  file  "IT-01. TCF" 
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C.5.2.  TEST  IT-02  -  DLP  /  ITWS  /  WARP  Buffering 

The  following  paragraphs  provide  information  about  data  associated  with  this 
test  but  not  included  within  the  main  body  of  this  report. 


C.5.2.1.  Associated  Evaluation  Criteria  and  Data 

The  following  Evaluation  Criteria  were  used  to  determine  the  requirements 
passed/failed.  The  Cross  Reference  (CR)  numbers  can  be  used  to  trace  into  the 
data  f ound/ref erenced  below. 


Pass  Fail 


a . 


b. 


c . 


d. 


[XX]  [  ]  Each  procedure  step's  "pass"  box,  in  the  'Observed  Results’ 

column,  was  marked,  indicating  the  'Expected  Response'  was 
observed.  (See  Appendix  C  for  the  test  procedure  performed 
for  test  IT-02 . ) 

[XX]  t  ]  Inspect  messages  arriving  at  the  WARP  simulator,  as  in  CR1-1 

&  CR1-3,  to  see  that  the  increasing  AWOS  message 
traffic  caused  multiple  AWOS  messages  to  be  delivered  in 
single  ADU,  as  in  CR2-1  CR2-2  &  CR2-3. 


[XX]  f  ]  Inspect  messages  arriving  at  the  DLP  simulator,  as  in  CR3-1 

cr3-2  &  CR3-3,  to  see  that  the  increasing  AWOS  message 

traffic  caused  multiple  AWOS  messages  to  be  delivered  in 
single  ADU,  as  in  CR4-1  CR4-2  &  CR4-3.  j 

[XX]  [  ]  Inspect  messages  arriving  at  the  ITWS  simulators,  as  in 

•  to  see  that  the  increasing  | 
AWOS  message  traffic  caused  multiple  AWOS  messages  to  be 
delivered  in  single  ADU,  as  in  CR6-A1:F1  CR6-A2:F2  &  I 

CR6-A3 : F3 .  - - ■ - 


The  following  data,  marked  with  evaluation  criteria  cross-reference  numbers, 
is  a  subset  of  the  OT&E  formal  test  run  data.  Other  relavent  data  has  been 
included  into  IT-02 's  Test  Conduct;  Form  (TCF)  file,  "IT-02. TCF". 

##  New  ADU  ##  INPUT  MESSAGE  #:  1 

ADU#:  1  |  TIME  -  (IPS):  08/18/97  18:53:04  -  (ADAS):  08/18/9718:53:04  |  msgs  3 
Hdr:  Sim-2  |  ADU  size:  209  |  Type:  DLP  Awos  |  OMO's  =3 
K002  K003  K001  . . : . 


##  New  ADU  ##  INPUT  MESSAGE  #:  9 

ADU#:  9  |  TIME  -  (IPS):  08/18/97  19:01:05  -  (ADAS):  08/18/9719:01:05  |  msgs  27 
Hdr:  Sim-2  |  ADU  size:  1865  |  Type:  DLP  Awos  |  OMO's  =  27 

K004  K010  K002  K008  K001  K011  K006  K012  K003  K007  K027  K009  K019  K005  K025 - 

K022  K015  K020  K026~  K023  K0i6 .  K0^ 

##  New  ADU  ##  INPUT  MESSAGE  #:  10 
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ADU#:  10  |  TIME  -  (IPS):  08/18/97  19:02:06  -  (ADAS):  08/18/9719:02:06  |  msgs 

30 

Hdr :  Sim-2  |  ADU  size:  2072  |  Type:  DLP  Awos  |  OMO's  =  30 _ _ _ _ _ _ 

K002  K005  K004  K010  K020  K008  K011  K003  K017  K006  K012  K001  K022  K015  K018 

K007  K027  K009  K023  K016  K029  K028  K024  K013  K019  K030  KO 2 5  K021.JC014  K026 . __ 

##  New  ADU  ##  INPUT  MESSAGE  #:  1  , 

ADU#:  1  I  TIME  -  (IPS):  08/18/97  18:53:14  -  (ADAS):  08/18/9718:53:14  |  msgs  3 

Hdr:  Sim-6  |  ADU  size:  254  |  Type:  ITWS1  Awos  |  ID:  KACY  |  OMO's  =  0x03 . — 

K002  K003  K001  .... . . . . . . . . - . . 


##  New  ADU  ##  INPUT  MESSAGE  #:  9  ,  n 

ADU#:  9  I  TIME  -  (IPS):  08/18/97  19:01:13  -  (ADAS):  08/18/9719:01:13  |  msgs  21 

Hdr:  Sim-6  |  ADU  size:  1910  |  Type:  ITWSl  Awos  |  ID:  KACY  |  OMO's  =  Oxlb . . 

K004  K010  K002  K008  K001  K011  K006  K012  K003  K007  K027  K009  K019  K005  K025 
K022  K015  K020  K026  K023  K016  K017  K013  K024  K018  K014  K021 _ _ _ 


##  New  ADU  ##  INPUT  MESSAGE  #:  10 

ADU#:  10  |  TIME  -  (IPS):  08/18/97  19:02:13 


-  (ADAS):  08/18/9719:02:13  |  msgs 


30 

Hdr: 

K002 

"K007 


Sim-6  |  ADU  size:  2117  |  Type:  ITWSl  ...Awos  |  ID:  KACY  I  OMO’s  =  Oxle . 

K005  K004  K010  K020  K008  K011  K00.3....K017  ...K00.6 ....K.0.12...K001___K02.2....K..015...K018. 
"k'02 7" "ko "6 9 ’"k’02 3  KOI 6  K02 9_  K028  K 024  KOI 3  K019  KC 3 0  K025  K021  K014  K026 


##  New  ADU  ##  INPUT  MESSAGE  #:  1  „  , 

ADU#:  1  I  TIME  -  (IPS):  08/18/97  18:53:14  -  (ADAS):  08/18/9718:53:14  |  msgs  3 
Hdr:  Sim-7  |  ADU  size:  254  |  Type:  ITWS2  Awos  |  ID:  KACY  |  OMO's  =  0x03 - 


K002  K003  K001 


##  New  ADU  ##  INPUT  MESSAGE  #:  9 

ADU#:  9  I  TIME  -  (IPS):  08/18/97  19:01:13  -  (ADAS):  08/18/9719:01:13 
Hdr:  Sim-7  |  ADU  size:  1910  |  Type:  ITWS2  Awos  |  ID:  KACY 


msgs  27 
OMO’s  =  Oxlb 


K004  K010  K002  K008  K001  K0 1 1  ..KO 0 6...K0.I2 ...K0 03  KO 07  K027....K0 0 9... K.01.9 .. KO 05 
KO22"'K'6T5''K020'''K0'26'"K02'3‘"K0i'6'''K0TT'K0i3  K024  K6.l8...K0.1.4..K021m; . . . ...__ 


##  New  ADU  ##  INPUT  MESSAGE  #:  10 

ADU#:  10  |  TIME  -  (IPS):  08/18/97  19:02:16 


(ADAS):  08/18/9719:02:16  |  msgs 


Hdr:  Sim-7  |  ADU  size:  2117  |  Type:  ITWS2  Awos  |  ID:  KACY  I  OMO's  =  Oxle - 

K002  K005  K004  K010  K020  K008  K011  K003  K017  K006  K012  K001  K022_K015_K01jB 
-K007“K027”K009"K023-K016'K 02 9  K028  K024 :....K013  KOI 9 ....K030. ...K025....K.0.2.1....K.0.1.4...K0^6_._._ 


##  New  ADU  ##  INPUT  MESSAGE  #:  1 

ADU#:  1  I  TIME  -  (IPS):  08/18/97  18:53:14  -  (ADAS):  08/18/9718:53:14  |  msgs  3 

Hdr:  Sim- 8  I  ADU  size:  254  I  Type:  ITWS3  Awos  |  ID:  KACY  |  OMO's  =  0x03  ._ . _.. 

K002  K003  K001  . . .  . 


##  New  ADU  ##  INPUT  MESSAGE  #:  9 

ADU#:  9  I  TIME  -  (IPS):  08/18/97  19:01:14  -  (ADAS):  08/18/9719:01:14  |  msgs  27 

Hdr:  Sim- 8  |  ADU  size:  1910  |  Type:  ITWS3  Awos  I  ID:  KACY  |  OMO's  =  Oxlb _ 

K004  K010  K002  K008  K001  K011  K006  K012  K003  K.0.0.7_K027  K009  K019  K005  K025 

H<02ricMT~K020~^2O02O0jJ^Mnil21lI^O ° ^  Ml 4  M 2 1 _ 


##  New  ADU  ##  INPUT  MESSAGE  #:  10 

ADU#:  10  |  TIME  -  (IPS):  08/18/97  19:02:  14  -  (ADAS):  08/18/97 1 9 : 02 : 14  |  msgs 

30 

Hdr:  Sim-8  |  ADU  size:  2117  |  Type:  ITWS3  Awos  |  ID:  KACY  I  OMO's  -  Oxle . 

K002  K005  K004  K010  K020  K008  K011  KO 6 3  KOI 7  K006  K012  K001  K022  K015  K018 
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-KQ Q ?■  K027  K009  K02 3  JK  O 1 6 __ K : 02 : 9 ...  K02  8  JK 024  KO 1 3  K019  K030  K025  K021  KOI 4  K026 

##  New  ADU  ##  INPUT  MESSAGE  #:  1 

ADU#:  1  |  TIME  -  (IPS):  08/18/97  18:53:14  -  (ADAS):  08/18/9718:53:14  |  msgs  3 
Hdr :  Sim-9  |  ADU  size:  254  |  Type:  ITWS4  Awos  |  ID:  KACY  I  OMO's  =  0x03 
K002  K003  K001  . “  . . . 


##  New  ADU  ##  INPUT  MESSAGE  #:  9 

ADU#:  9  |  TIME  -  (IPS):  08/18/97  19:01:15  -  (ADAS):  08/18/9719:01:15  |  msgs  27 
Hdr:  Sim-9  |  ADU  size:  1910  |  Type:  ITWS4  Awos  |  ID:  KACY  |  OMO's  =  Oxlb 

__K004  K010  K002  K008  K001  K011  KO 0 6  KO 12 ' KO 03  ' KO 0 7  K027  K009  K019  K005  K025 . 

K022  K015  K020  K026  K023  K016~K01~7  KOlT  K024  ~K018  KOI  4  K021  ' 


##  New  ADU  ##  INPUT  MESSAGE  #:  10 

ADU#:  10  |  TIME  -  (IPS):  08/18/97  19:02:14  -  (ADAS):  08/18/9719:02:14  |  msgs 


Hdr: 

K002 

Sim- 9 
K005 

I  ADU 
K004 

’  size 
K010 

:  2117  | 

Type: 

ITWS4 

Awos 

1  ID:  KACY  | 

OMO's 

=  Oxle 

KUz  U 

KUOS 

K011 

K003 

K017 

K006 

K012 

K001 

K022 

K015  K018 

K007 

K027 

K009 

K023 

K016 

K02  9 

K02  8 

K024 

K013 

K019 

K030 

K025 

K021 

K014  K026 

##  New  ADU  ##  INPUT  MESSAGE  #:  1 

ADU#:  1  |  TIME  -  (IPS):  08/18/97  18:53:14  -  (ADAS):  08/18/9718:53:14  |  msgs  3 
Hdr:  Sim-10  |  ADU  size:  254  |  Type:  ITWS5  Awos  |  ID:  KACY  I  OMO's  =  0x03 
K002  K003  K001  -  - 


##  New  ADU  ##  INPUT  MESSAGE  #:  9 

ADU#:  9  |  TIME  -  (IPS):  08/18/97  19:01:16  -  (ADAS):  08/18/9719:01:16  |  msgs  27 
Hdr:  Sim-10  |  ADU  size:  1910  |  Type:  ITWS5  Awos  |  ID:  KACY  |  OMO’s  =  Oxlb 

KOIO  K002 K008  K001  K011  K006  K012  K003  K007  K027  K009  K019  K005  K025 
K022  K015  K020  K02 6  K023  KO  1 6  K0i'7'"K0l'3'"K02T''K018""K0T4"K62’i . . . • . : . : . 


##  New  ADU  ##  INPUT  MESSAGE  #:  10 

ADU#:  10  |  TIME  -  (IPS):  08/18/97  19:02:15  -  (ADAS):  08/18/9719:02:15  |  msgs 


Hdr: 

K002 

Sim- 10 
K005 

1  ADU  size:  2117  | 

Type 

:  ITWS5  Awos  | 

ID:  KACY  | 

OMO' 

s  -  Oxle 

rwu4 

U1U 

RUZU 

KUUo 

K011 

K003 

K017 

K006 

K012 

K001 

K022 

K015  K018 

K007 

K027 

K009 

K023 

K016 

K029 

K028 

K024 

K013 

K019 

K030 

K025 

K021 

K014  K026 

##  New  ADU  ##  INPUT  MESSAGE  #:  1 

ADU#:  1  |  TIME  -  (IPS):  08/18/97  18:53:14  -  (ADAS):  08/18/9718:53:14  |  msgs  3 
Hdr:  Sim-11  |  ADU  size:  254  |  Type:  ITWS6  Awos  |  ID:  KACY  I  OMO's  =  0x03 
K002  K003  K001  . .  . 


##  New  ADU  ##  INPUT  MESSAGE  #:  9 

ADU#:  9  |  TIME  -  (IPS):  08/18/97  19:01:16  -  (ADAS):  08/18/9719:01:16  |  msgs  27 
Hdr:  Sim-11  |  ADU  size:  1910  |  Type:  ITWS6  Awos  |  ID:  KACY  |  OMO's  =  Oxlb 

KQ04  K010  K00 2  K008  K001  K011  K006  K012”K06"3"K007  K027  K009  K019  K005  K0'25 . 

,_K022_K01_5  K02  0  Kp_26  K023  K016  K017  K013  K024  K018  K014  K021  — 


##  New  ADU  ##  INPUT  MESSAGE  #:  10 

ADU#:  10  |  TIME  -  (IPS):  08/18/97  19:02:16  -  (ADAS):  08/18/9719:02:16  |  msgs 

Hdr:  Sim-11  |  ADU  size:  2117  |  Type:  ITWS6  Awos  |  ID:  KACY  I  OMO's  =  Oxle 

K005  K004  K010  K020  K008  K011  K~d03""K017"K006  K012  K001  K022  K015  K018 . 

K007  K027  K009  K023  KOI 6  K029  K028''K0"24 ’"KOlX' WrX'K030'K^ 

##  New  ADU  ##  INPUT  MESSAGE  #:  1 

ADU#:  1  |  TIME  -  (IPS):  08/18/97  18:53:04  -  (ADAS):  08/18/9718:53:04  | 
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msgs  3 


Hdr:  Sim-4  I  ADU  size:  209  I  Type:  RWP  Awos  I  OMO's  =  3  . 

##  New  ADU  ##  INPUT  MESSAGE  #:  9  „  „ 

ADU#:  9  I  TIME  -  (IPS):  08/18/97  19:01:06  -  (ADAS):  08/18/9719:01:06  |  msgs  27 
hhv  d  i  Ann  si7p:  1  8  65  1  Tvoe :  RWP  Awos  I  OMO's  =  27  . . . . . 

K004  K010  K002  K008  K001  K011  K006  K012  K003  K007  K027  K009  K019  K005  K025 

K022  K015  K020  K026  K023  K016  K017  K013  K024  K018  K014  K021  . . 

##  New  ADU  ##  INPUT  MESSAGE  #:  10  _ 

ADU#:  10  |  TIME  -  (IPS):  08/18/97  19:02:06  -  (ADAS):  08/18/9719:02:06  |  msgs 

30 

Hdr-  Sim  4  |  ADU  size:  2072  1  Type:  RWP  Awos  |  OMO's  -  30  . 

K002  K005  K004  K010  K020  K008  K011  K003  K017  K006  K012  K001  K02.2..K015_._K018 

K0 07  K027  k'66'9  K023  K016  K029  K028  K024  KOI 3  KOI 9  K030  K025  K021  K014  K026 
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C.5.3.  TEST  IT-03  -  DLP  /  ITWS  /  WARP  Variable  Length  Messages 

The  following  paragraphs  provide  information  about  data  associated  with  this 
test  but  not  included  within  the  main  body  of  this  report. 


C.5.3.1.  Associated  Evaluation  Criteria  and  Data 


The  following  Evaluation  Criteria  were  used  to  determine  the  requirements 
passed/failed.  The  Cross  Reference  (CR)  numbers  can  be  used  to  trace  into  the 
data  f ound/ref erenced  below. 


Pass  Fail 


a . 


a . 


b. 


[XX]  [  ]  Each  procedure  step's  "pass”  box,  in  the  ’Observed  Results' 

column,  was  marked,  indicating  the  'Expected  Response'  was 
observed.  (See  Appendix  C  for  the  test  procedure  performed 
for  test  IT-03 . ) 


[XX]  [  ]  Inspect  the  data  reduction  summary  of  messages  arriving  at 

the  DLP,  as  in  CR1,  at  the  ITWS,  as  in  CR5 ,  CR6,  CR7 ,  CR8 , 
CR9,  &  CR10,  WARP,  as  in  CR2,  simulators  to  see  that  the 
increasing  AWOS  message  traffic  caused  multiple  variable 
length  AWOS  messages  to  be  delivered  in  single  ADU. 

[XX]  [  ]  Individual  AWOS  messages  should  be  unchanged  and  complete. 

Type  1,  as  in  CR3,  contains  remarks.  Type  2,  as  in  CR4,  | 
contains  longer  remarks. 


The  following  data,  marked  with  evaluation  criteria  cross-reference  numbers, 
is  a  subset  of  the  OT&E  formal  test  run  data.  Other  relavent  data  has  been 
included  into  IT-03 's  Test  Conduct  Form  (TCF)  file,  "IT-03. TCF". 

##  New  ADU  ##  INPUT  MESSAGE  #:  1 

ADU#:  1  |  TIME  -  (IPS):  08/18/97  19:36:04  -  (ADAS):  08/18/9719:36:04 
Hdr:  Sim-2  |  ADU  size:  318  |  Type:  DLP  Awos  |  OMO’s  =  3 
AWOS/ASOS  ID:  K002  I  CFG  NO:  0000  |  DATE: 97/08/18  TIME:  19:36:00 

AUTOMATED  REMARKS:  Wby300vT00~WND~01V08T  . 

AWOS/ASOS  ID  :  K00 3 . |'  cfg'n6T'''o  . f'DA^^ . 19:36:00 . . . 

OPERATOR  REMARKS:  VSBY  125V250  WND  26V33  CIG  10V20  BKN  V  OVC ! 

AWOS/ASOS  ID:  K001  |  CFG  NO:  0000  |  DATE: 97/08/18  TIME:  19:36:00 
OPERATOR  REMARKS: . VSBY  125V250  WND  26V33  CIG  10V20  BKN  V  OVC! 

##  New  ADU  ##  INPUT  MESSAGE  #:  2 

ADU#:  2  1  TIME  -  (IPS)  :  "08/18/97  19 : 37: 04  -  (AI)AS)  :  08/18/9719:37:04 

Hdr:  Sim-2  |  ADU  size:  614  |  Type :  DLP  Awos  j '~OMOt s  =  6~" . 

AWOS/ASOS  ID:  K002  [  CFG  NO:  6 000  j  DATE : 9 7/0 8/ 1 8  TIME :  19:37:00 

AUTOMATED  REMARKS  :  VSBY  10  0V8  0 io""'WND'""0 1V0  8’T . 

AWOS/ASOS  ID:  K003  |  CFG " NO:  0000  T DAT E79 7? 0 8 / 1 8  TIME:  19:37:00 

. VSBY125V2 5 0  WND  26V33  CIG  10V20  BKN  V  OVC! 

AWOS/ASOS  ID:  K005  j  CFG  NO:  0000  j  DATE:  97/08718  TIME:  "'19737  :  00 
OPERATOR  REMARKS:  VSBY" I25V250 WND '  26V3X  CIG^ 
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AWOS/ASOS  ID:  K004 

|  CFG  NO:  0000 

|  DATE: 97/08/18  TIME:  19:37:00 

AUTOMATED  REMARKS: 

VS  BY  100V800 

WND  01 V0 8! 

AWOS/ASOS  ID:  K001 

|  CFG  NO:  0000 

i  DATE: 97/08/18  TIME:  19:37:00 

OPERATOR  REMARKS: 

VS BY  125V250  WND  26V33  CIG  10V20  BKN  V  OVC ! 

AWOS/ASOS  ID:  K006 

|  CFG  NO:  0000 

|  DATE: 97/08/18  TIME:  19:37:00 

AUTOMATED  REMARKS: 

VS BY  100V800 

WND  01V08 ! 

##  New  ADU  ##  INPUT 

MESSAGE  # :  10 

19:45:07  -  (ADAS):  08/18/9719:45 

ADIT#:  10  1  TIME  -  ( 

IPS) :  08/18/97 

Hdr :  Sim-2  ADU  size:  3062  |  Type 

::  DLP  Awos  j  OMO's  =  30 

AWOS/ASOS  ID:  K004 

|  CFG  NO:  0000 

i  DATE: 97/08/18  TIME:  19:45:00 

AUTOMATED  REMARKS: 

VSBY  100V800 

WND  01V08 ! 

AWOS/ASOS  ID:  K012 

|  CFG  NO:  0000 

j  DATE: 97/08/18  TIME:  19:45:00 

AUTOMATED  REMARKS: 

VSBY  100V800 

WND  01 V0 8! 

AWOS/ASOS  ID:  K001 

|  CFG  NO:  bbbb 

i  DATE: 97/08/18  TIME:  19:45:00 

OPERATOR  REMARKS: 

VSBY  125V250  WND  26V33  CIG  10V20  BKN  V  OVC! 

AWOS/ASOS  ID:  K009 

|  CFG  NO:  0000 

1  DATE: 97/08/18  TIME:  19:45:00 

OPERATOR  REMARKS: 

VSBY  125V250  WND  26V33  CIG  10V20  BKN  V  OVC! 

AWOS/ASOS  ID:  K007 

|  CFG  NO:  0000 

1  DATE: 97/08/18  TIME:  19:45:00 

OPERATOR  REMARKS: 

VSBY  125V250  WND  26V33  CIG  10V20  BKN  V  OVC! 

AWOS/ASOS  ID:  K028 

|  CFG  NO:  0000 

|  DATE:  97/08/18  TIME:  iy:45:uu 

AUTOMATED  REMARKS: 

VSBY  100V800 

WND  01V08 ! 

AWOS/ASOS  ID:  K022 

|  CFG  NO:  0000 

1  DATE: 97/08/18  TIME:  19:45:00 

AUTOMATED  REMARKS: 

VSBY  100V800 

WND  01V08 ! 

AWOS/ASOS  ID:  K002 

|  CFG  NO:  0000 

[  DATE: 97/08/18  TIME:  19:45:00 

AUTOMATED  REMARKS: 

VSBY  100V800 

WND  01 V0 8! 

AWOS/ASOS  ID:  KOI 3 

|  CFG  NO:  bbbO 

j  DATE: 97/08/18  TIME:  19:45:00 

OPERATOR  REMARKS: 

VSBY  125V250  WND  26V33  CIG  10V20  BKN  V  OVC! 

AWOS/ASOS  ID:  K010 

|  CFG  NO:  0000 

1  DATE: 97/08/18  TIME:  19:45:00 

AUTOMATED  REMARKS: 

VSBY  100V800 

WND  01V08 ! 

AWOS/ASOS  ID:  K008 

|  CFG  NO:  OObb 

|  DATE: 97/08/18  TIME:  19:45:00 

AUTOMATED  REMARKS: 

VSBY  100V800 

WND  01V08 ! 

AWOS/ASOS  ID:  K029 

|  CFG  NO:  0000 

i  DATE: 97/08/18  TIME:  19:45:00 

OPERATOR  REMARKS: 

VSBY  125V250  WND  26V33  CIG  10V20  BKN  V  OVC! 

AWOS/ASOS  ID:  HO 2 5 

|  CFG  NO:  0000 

|  DATE: 97/08/18  TIME:  19:45:00 

OPERATOR  REMARKS: 

VSBY  125V250  WND  26V33  CIG  10V20  BKN  V  OVC! 

AWOS/ASOS  ID:  K023 

|  CFG  NO:  0000 

I  DATE: 97/08/18  TIME:  19:45:UU 

OPERATOR  REMARKS: 

VSBY  125V250  WND  26V33  CIG  10V20  BKN  V  OVC! 

AWOS/ASOS  ID:  K020 

|  CFG  NO:  0000 

1  DATE :97/08/18  TIME:  19:45:00 

AUTOMATED  REMARKS: 

VSBY  100V800 

WND  01V08 ! 

AWOS/ASOS  ID:  K003 

!  CFG  NO:  0000 

i  DATE : 9 7 7 0 8 / 1 8  TIME:  19:45:00 

OPERATOR  REMARKS: 

VSBY  125V250  WND  26V33  CIG  10V20  BKN  V  OVC! 

AWOS/ASOS  ID:  KOI 4 

|  CFG  NO:  0000 

|  DATE: 97/08/18  TIME:  19:45:00 

AUTOMATED  REMARKS: 

VSBY  100V800 

WND  01V08 ! 

AWOS/ASOS  ID:  K011 

|  CFG  NO:  0000 

1  DATE: 97/08/18  TIME:  19:45:00 

OPERATOR  REMARKS: 

VSBY  i"25V250  WND  26V33  CIG  10V20  BKN  V  OVC! 

AWOS/ASOS  ID:  K030 

j  CFG  NO:  0000 

|  DATE: 97/08/18  TIME:  19:45:00 

AUTOMATED  REMARKS: 

VSBY  100V800 

WND  01V08 ! 

AWOS/ASOS  ID:  K00S 

|  CFG  NO:  00 00 

j  DATE: 97/08/18  TIME:  19:45:00 

OPERATOR  REMARKS: 

VSBY  125V250  ’ 

WND  26V33  CIG  10V20  BKN  V  OVC! 

AWOS/ASOS  ID:  K026 

|  CFG  NO:  00 00 

i  DATE: 97/08/18  TIME:  19:45:00 

AUTOMATED  REMARKS: 

VSBY  100V800 

WND  01V08 ! 

AWOS/ASOS  ID:  K024 

|  CFG  NO:  oobb 

I  DATE: 97/08/18  TIME:  19:45:00 

AUTOMATED  REMARKS: 

VSBY  100V800 

WND  01V08 ! 

AWOS/ASOS  ID:  K017 

|  CFG  NO:  0000 

f  DATE: 97/08/18  TIME:  19:45:00 

OPERATOR  REMARKS: 

VSBY  125V2S0 

WND  26V33  CIG  10V20  BKN  V  OVC! 

AWOS/ASOS  ID:  KOI 5 

|  CFG  NO:  0000 

i  DATE: 97/08/18  TIME:  19:45:00 

OPERATOR  REMARKS: 

VSBY  125V250 

WND  26V33  CIG  101720  BKN  V  OVC! 

C-291 


AWOS/ASOS  ID;  K006  |  CFG  NO:  0000  |  DATE: 97/08/18  TIME:  19:45:00 

AUTOMATED  REMARKS  :  VSBY T0OV8OO ^  WNP' 01V08T . • . . . 

AWOS/ASOS  ID:  K027  |  CFG‘'NO:“”'006o“T"' DA? E :'97/ 0 8 / 1 8  TIME:  19:45-00 
OPERATOR  REMARKS:  VSBY  125V250~WND  26V33  CIG  10V20^BKI?‘ V“0VCT“ 

AWOS/ASOS  ID:  K021  |  CFG  NO:  00 0 0  j  DATE :97/08/18  TIME:  19:45:00 

■ VS  BY  12  5  V  2  5  6  WND  26V33  CIG  l-0^'o'”BiOT'"V''6vcT""' 

AWOS/ASOS  ID:  K018  j  CFG~N6:~"6000'"n"'"""^TE":^T7087'l8'""TIME": . 19  :'4 5:0 0 

AUTOMATED  REMARKS:  VSBY  100V800  WND  01V08!  - - 

AWOS/ASOS  ID:  KOI 6  |  CFG  NO:  00W  f" DAT E :' 9 T/ 0 8 / 1 8  TIME:  19:45:00 

AUTOMATED  REMARKS  :  '' . WBY  TbW8M'"iWD'"Mv6T! . . . ' . " . 

AWOS/ASOS  ID:  KOI 9  j  CFG  NO:  0000 _  j  DATE : 97/ 08/18  TIME :  19:45:00 
OPERATOR  REMARKS:  VSBY  i25V250  WND  26V33  CIG10V2  0  BKN~  V  OVC ! 

M.  New  ADU  ##  INPUT  MESSAGE  #:  1 

ADU# : ^ 1  |  TIME  -  (IPS):  08/18/97  19:36:14  -  (ADAS):  08/18/9719:36:14  |  msqs  3 
Hdr:  Sim-6  |  ADU  size:  363  |  Type:  ITWS1  Awos  |  ID:  KACY  I  OMO’s  =  0x03 
..K002  K003  KOO'i  . “ . . . ~ . . . . . 

##  New  ADU  ##  INPUT  MESSAGE  #:  10 

_ 10  I  TIME  -  (IPS):  08 718/9 7  19:45:14  -  (ADAS):  08/18/9719:45:14  I  msas 

30  "  ”  1 - 

Mg.j---.Slm~  6  |  .  ADU  size:  3107  |  Type:  ITWS1  Awos  |  ID:  KACY  |  OMO's  =  Oxle 
K004  K012  K001  K009  K007  K028  kd22"' KOO’2 '"KOi"3'''KOTo"' K008'''M29'"k025'"k023'"ko?Q 
-g° 03  K014  K011  K030  K005  K026  K024  K017  K015  K006  K027  K021  K018  K016  K0T9 


M..New  .ADU  ##  INPUT  MESSAGE  #:  1 


ADU#:  1  | 

TIME  -  (IPS):  08/18/97  19 

: 36: 14 

-  (ADAS):  08/18/9719:36:14  1  msqs 

3 

Hdr:  Sim- 

1  ADU  size:  363  |  Type: 

ITWS2 

Awos 

j  ID:  KACY  |  OMO's  =  0x03 

K002  K00 

K001 

##  New  ADU 

##  INPUT  MESSAGE  #:  10 

ADU#:  10  | 

TIME  -  (IPS) :  08/18/97 

19:45: 

16  - 

(ADAS):  08/18/9719:45:16  |  ms 

qs 

30 

Hdr:  Sim-7 

1  ADU  size:  3107  |  Type: 

ITWS2 

Awos 

I  ID:  KACY  |  OMO's  =  Oxle 

K004  K012 

kobi  ko 09  kb 67  ko28  kb'22 

K002 

K013 

ko i 6  K0 08  K029  K025  K023  K020 

KO 03  K014 

K011  K030  K005  K026  K024 

K017 

K015 

K006  K027  K021  K018  K016  KOi.9 

##  New  ADU 

##  INPUT  MESSAGE  #:  1 

ADU#:  1  |  TIME  -  (IPS)  :  b8/l'8/97  19 

: 36: 14 

-  (ADAS):  08/18/9719:36:14  1  msas 

3 

Hdr:  Sim- 8 

1  ADU  size:  363  |  Type: 

ITWS3 

Awos 

1  ID:  KACY  |  OMO's  =  0x03 

K002  K003 

K001 

##  New  ADU  ##  INPUT  MESSAGE  10 

ADU#:  10  [  TIME  -  (IPS):  08/18/97  19:45:20  -  (ADAS):  08/18/9719:45:20  I  msas 

30  - - - - a  - 

. I  ADU  size:  3107  J  Type:  ITWS3  Awos  |  ID:  KACY  |  OMO's  =  Oxle 

K004  K012  K00i  K00'9  K007  k628”’k022" "k002'" K0T3" Wro’’K008’"KOT^W25"‘KW3“'K020 
-..gP_QA  K014  K011  K030  K005  K026  KC24  K017  K015  K006  K027  K021  K018  K016  K019 

##  New  ADU  ##  INPUT  MESSAGE  #:  1 

ADU#:_1  j  TIME  -  (IPS) :  08718797  19:36:14  -  (ADAS) :  08/18/9719:36:14  |  msqs  3 

Hdr:  Sim-9  |  ADU  size:  363  |  Type:  ITWS4  Awos  I . ID:  KACY  j  OMO's  =  0x03 

K002  K003  K001  ~  -  - - - - - - — - - — - 

##  New  ADU  ##  INPUT  MESSAGE  #:  10 

|9U|:10 . j . TIME- . [i  PS )  0  8  / 1 8  [91  1 9 :  4  5  j:  1 7 . (ADAS)  :  08/18/9719:45:17  |  msgs 

M£..;...-gAglT9  )  APU  size:  3107  |  Type:  ITWS4  Awos  |  ID:  KACY  |  OMO's  =  Oxle 

. C-292 . . . 


K004  K012  K001  K009  K007  K028  K022  K002  KOI  3  KOIO  K0Q8  K029  K025  K023  K020 
"k003 '"ko'14 KO'iT ^  K03b  '  k005  K02  K027  K021  KQ18  ko"j"6  K0l9 

##  New  ADU  ##  INPUT  MESSAGE  #:1 

ADU#:  1  j  TIME  -  (IPS) :  08/18/97  19:36:14  -(ADAS):  08/18/9719:36:14  I  msgs  3 
Hdxr*:"""*Sim— "i~0**""~l  ADU  "s'iz'e  :*""3~6~3  *|  "Typ€:'"""*I*TWS~5‘ "Awos  j  ID:  KACY  j  OMO's  =  0x03 

''W6Tkoo3’'k'6oi . . 


##  New  ADU  ##  INPUT  MESSAGE  #:  10 

ADU#i . 10  "T  "  TIME'"'- . (IPS):  "08718797  19:45:18  -  (ADAS): . 08/18/9719:45:18 . 1 . msgs 

30 . . . . . . . 

Hdr :  Sim-10  |  ADU  size:  3107  |  Type:  ITMS5  Awos  j_  ID:  KACY  |  OMO's  =  Oxle 
K004  K0L2  K001  K009  'k607~K028~K022  K002  K013~K010  K008  K029  K025  K023  K020 
" K003 K0i4  KOli ^  K030  kb05  K0’2  6  "i<024  KOI 7  K015  k'006  K027  K02i  k'018  K016  KOI 9 . 

##  New  ADU  ##  INPUT  MESSAGE  #:  1 

ADU#:  1  |  TIME"-  ( I PS)T  08/18797  19:36:14  ~  (ADAS):"  08/18/9719:36:14  |  ms.gs.J 
Hdr Sim- "l I”"j  ADU  si  z  e :  363  j  Type:  ITWS6  Awos . j  ID:  KACY  |  OMO's  =  0x03 

'"'k'd’o'2""k"o"o’"3"'koo'i . 

##  New  ADU  ##  INPUT  MESSAGE  #:  10 

ADU# :  "io . i . •fji^"'-^FPS77'^87l8797  19:45:19  -  (ADAS)  :  08/18/9719:45:19 . [....msgs 

30 . 

Hdr:  Sim-11  |  ADU  size:  3107  |  Type:  ITWS6  Awos  |  ID:  KACY  |  OMO's  =  Oxle 

7k¥6TWiiTKdoi'"koW''i^orKoT8'"kd2ri(o62  KQi3""koi6  kooi  ko'29  K023  ko23  K020 
''"'ko'03' ’’'’KOTJ’  Kdil  KO  KO 17  KOI 5  k006  K.027  K021  ...Kpjg ...KQ16 ...K019 . 

##  New  ADU  ##  INPUT  MESSAGE  #:  1 

ADU#:  1  ["""TIME  -  ( IPS):  08/18/97  19:36:04  -  (ADAS):  08/18/9719:36:04  ..L.msgs...3 

Awos  |  OMO '  s  =  3 

'■"k'6d'2"‘'K'od3"  "k'o'oi . 


##  New  ADU  ##  INPUT  MESSAGE  #:  10 

ADU#"; . 1  b-fTiME'"- . (IPS p . 0 871  87  9  7  1  9  :  4 5  :  08  - . (ADAS)  : . 08/18/9719:45:08 . | . msgs 

30 . . . . . . . . . : . 

Hdr:  Sim-4  |  ADU  size:  3062  |  Type:  RWP  Awos  I  OMO's  =  30 
K004  K012  K001  K009  K007  K028  K022  K002  K013  K010  K008  K029  K025  K023..K020 
K603  k6i4k6l  1K030  K 0 05  K026  k024  k6l7  koi5  kbo'6  k027  K021  K018  K016  K019  
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C.5.4.  TEST  IT-04  -  DLP  /  ITWS  /  WARP  Message  Errors 

The  following  paragraphs  provide  information  about  data  associated  with  this 
test  but  not  included  within  the  main  body  of  this  report. 


C.5.4.1.  Associated  Evaluation  Criteria  and  Data 

The  following  Evaluation  Criteria  were  used  to  determine  the  requirements 
passed/failed.  The  Cross  Reference  (CR)  numbers  can  be  used  to  trace  into  the 
data  f ound/ref erenced  below. 


Pass  Fail 

[XX]  [  ]  Each  procedure  step's  "pass"  box,  in  the  'Observed  Results' 

column,  was  marked,  indicating  the  'Expected  Response'  was 
observed.  (See  Appendix  C  for  the  test  procedure  performed 
for  test  IT-04 . ) 


[XX]  [  ]  Entries  in  the 'IPS  Inbound  Message  log  must  indicate  that 

the  DLP  CRl,  WARP  CR2 ,  and  ITWS1:6  CR12:17  simulator 
received  multiple  messages  in  single  ADU  (Input  Message) . 

[  ]  [XX]  The  ADAS  logs  must  indicate  that  an  Error  ,  as  in  OR3  (56  in 

all),  and  Event  entry  were  made  for  each  error  message 
returned  to  ADAS  (7  DLP  CR4 ,  7  WARP  CR5,  and  7  each  (42 

total)  for  ITWS1 : 6  CR6: 11  ]  7 

.  .?.?.?.9.?..*....Miss.i.nc[._.CR' s._  5  through  10  due  to  IPS  sequence  error. 


The  following  data,  marked  with  evaluation  criteria  cross-reference  numbers, 
is  a  subset  of  the  OT&E  formal  test  run  data.  Other  relavent  data  has  been 
included  into  IT-04 's  Test  Conduct  Form  (TCF)  file,  "IT-04. TCF". 

EVENT  PRIORITY:  non-critical  DATE/TIME  STAMP:  08-18-97  20:17:05 
EVENT  SEQ.  NUMBER:  918 EVENT  TYPE:  21  CSC  ID:  11.02 

An  erroneous  message  has  been’ ''triggered 'by"sys'te^ 

. ADAS  received  error  message 

. gr.f9.y...type ?  DLP  error  message . e’rror""code :  DLP  invalid  ADU  type  rcvd 

original  esc  id:  4.07  error  number:  1  . . . . 

error  offset:  0  . . . : . 


.EVENT  PRIORITY;  non-critical  DAT E / T I ME  S TAM P:  08-18-97  20:18:05 

EVENT  SEQ.  NUMBER:  935  EVENT  TYPE:  21  . CSC  ID:  11.02 . 

An  erroneous  message  has  been  triggered  by  System  Logging. 

. ??®.?.?.®9®...type:  ApAS  received  error  message 

_ error  type:  DLP  error  message  error  "code:  DLP  invalid  ADU  type  rcvd 

original  esc  id:  4.07  error  number:  2 
error  offset:  53 


EVENT  PRIORITY:  non-critical  DATE/TIME  STAMP:  08-18-97  20:19:06 


C-296 


EVENT  SEQ.  NUMBER:  951  EVENT  TYPE:  21 . CSC  ID:  11.02 

An  erroneous  message  has  been  triggered  bY  Syst?.n!--.i'.955.?r.?}.9.:. 

message  type:  ADAS  received  error  message 
error  type:  DLP  error  message  error  ..code: 

. original  esc  id:  4.07  error  number:  3 

error  offset:  106 

EVENT  PRIORITY:  non-critical  DATE/TIME  STAMP:  08-18-97  20:20:05 

EVENT  " SEP ^NUMB'ERT"  967 . 'eVENT  "TYPE':'  "21 . CSC  ID:  1  j .  02 

An  erroneous  message  has  been  tr^gg^e^by_Sj^tem_Logging. 


message  type:  ADAS  received  error  message 

'e¥ror'' t^e:'"'DLT'"er¥or"'mess¥ge  error  code:  DLP  Invalid .ADU  type.rcvd 

'ori'ginaI'''csc"'id:"''4'r67  error  number :  4 
error  offset:  159 


EVENT  PRIORITY:  non-critical  DATE/TIME  STAMP:  08-18-97  20:21:06 

_ EVENT  TYPE:  21 .  CSC  ID:  il.02 

An  erroneous  message  has  been  triggered  by  System  Logging. 

message  type:  ADAS  received  error  message 

. error  type •’’’  DLP  error  message _ error  code:  DLP  invalid  ADU  type  revd 

original  esc  Xd :  4707  error  number:  5 
error  offset:  212 

EVENT  PRIORITY:  non-critical  DATE/TIME  STAMP:  08-18--97  20: 22.: 06 

EVENT'  SEQ.  NUMBER:  9 9 9  EVENT  TYPE :  2 1 . . CSC  ib:  11. .02 

An  erroneous  message  has  been  triggered  by  .  System  ^Logging... 

message  type:  ADAS  received  error  message 

error  type:  DLP  error  message  error  code:  DLP  invalid  ADU  type.rcvd 
orTgTnai  IpcXdTl  .  07  error  nun£er :  6 
error  offset:  265 

EVENT  PRIORITY:  non-critical  DATE/TIME  STAMP:  08-18-97  20:23:07 

EVENT  SEQ.  NUMBER:  1015  EVENT  TYPE:  21 . ; . CSC  ID:  11.02 

An  erroneous  message  h.3.s...be®^  triggered  by  System  Logging. 

message  type:  ADAS  received  errop  message 

error  'type :~~DLP "error ""message  error  code:  DLP  invalid  Apu.type_rcyd 

. original  esc  id:  4.07  error  number:  7 

error  offset:  318 . . . . . . . . _ _ _ _ _ _ — 

EVENT  NUMBER:  918  DATE/TIME  STAMP :  0 8  —  1 8  —  97  20:  1V: 05 

ERRoFsEgX^BERri . CSC'  IdT  4 . 07 

MESSAGE '  TYPE 

ERROR  TYPE:  301  ERROR  CODE:  303 


8101  0258  5858  5858  5858  5858  5858  5858  5858  5858  5858  58 

EVENT  NUMBER:  935 _ DATE/TIME  STAMP:  08-18-97  20:18:  05 

ERROR  SEQ.  NUMBER:  2 CSCID:4.07 

MESSAGE  TYPE:  0 . ■ . 

ERROR" "type 301 _ ERROR  CODE:  303 


8101  0258  5858  5858  5858  5858  5858  585858585858505858 
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EVENT  NUMBER:  951  DATE/TIME  STAMP:  08-18-97  20:19:06 

ERROR  SEQ.  NUMBER:  3 . CSC 'lii)TT."07 . 

MESSAGE  TYPE:  0 . " 

ERROR  TYPE:  301 _ ERROR  CODE:  303 

8101  0258  5858  5858  5858  5858  5858  5858  5858  5858  5858  58 

EVENT  NUMBER:  967  DATE/TIME  STAMP:  08-18-97  20:20:05 

ERROR  SEQ.  NUMBER:  4  . CSCTdT"0'7 . 

MESSAGE'' TYPE:'''0 . . . . . 

ERROR  TYPE:  301 _ ERROR  CODE:  303 

8101  0258  5858  5858  5858  5858  5858  5858  5858  5858  5858  58 

EVENT  NUMBER:  983  DATE/TIME  STAMP:  08-18-97  20:21:06 

ERROR  SEQ.  NUMBER:  5  CSC  ID:  4.07 

MESSAGE  TYPE:  0  .  .  . 

ERROR  TYPE:  301 ERROR  CODE:  303 

8101  0258  5858  5858  5858  5858  5858  5858  5858  5858  5858  58 

EVENT  NUMBER:  999  DATE/TIME  STAMP:  08-18-97  20:22:06 

ERROR  SEQ .  NUMBER : '"'6 . "'CSC"' ID  i'T '."67 . " 

MESSAGE  TYPE:  0  ~  ~  ~  ~ 

ERROR  TYPE:  TOI ERROR  CODE:  303 

8101  0258  5858  5858  5858  5858  5858  5858  5J358  5858  5858  58 

?yMT...MMBER:1015  DATE/TIME  STAMP:  08-18-97  20:23:07 

ERROR  SEQ.  NUMBER:  7  CSC  ID:  "4  To 7 . 

MESSAGE' TYPE  .  ’ . 

ERROR  TYPE:  301 ERROR  CODE:  303 

8101  0258  5858  5858  5858  5858  5858  5858  5858  5858  5858  58 


##  New  ADU  ##  INPUT  MESSAGE  8:  1 

ADy£:....l...J....TIME ..J.IPSfj J....08/18/97__2_0: 14 : 05  -  (ADAS):  08/18/9720:14:  05  |  msgs  3 

Hdr :  Sim-2  |  ADU  size:  209  |  Type’:  ';DL'p''Awo's'"''j'”"OM6'’’s'"=''"'3 . . . . . . . . 

K002  K003  K0 61" . . . ! . ■ . 


##  New  ADU  ##  INPUT  MESSAGE  #:  10 

WliJO  I  TIME  -  (IPS):  68/18/97  20:23:06  -  (ADAS):  08/18/9720:23:06  |  msgs 

. . . 2 


Hdr:  Sim-2  |  ADU  size:  2072  |  Type:  DLP  Awos  |  OMO's  =  30 
K003  K009  K007  K004  K010  K005  K001  K011  K015  K006  K025  K019  K030  K002  K012 
K008  K016  K022  K026  KOSs  '  koSo '  ^ 


##  New  ADU  ##  INPUT  MESSAGE  #:_  1 

~  (IPS)  :  08718/97 ^  20  :14  ?.,14  -  (ADAS)  :  08/18/9720 : 14:14  |  msgs  3 

Hdr Sim- 6  I  ADU  size:  254  |  Type:  ITWS1  Awos  i . . 

K002  K003  K001  . . . . . 

##  New  ADU  ##  INPUT  MESSAGE  #:  10 

MM.L.lP.....L....f.|ME 20:23:14  -  (ADAS)  :  08/18/9720:23:14  |  msgs 

H^rl _sim~6  I  ADU  size:  2117  |  Type:  ITWS1  Awos  |  ID:  KACY  |  OMO's  =  Oxle 
■.-H003..K009  K007  KOOj  KOIO  KOOS  k66f"K01l"¥6Tr'KW6lc02r'¥6T'^y^^ 

—HO 0 8K016  K022  K02 6  K02 9  K02 0  K0 13' " K023 ^ " k'6’2' '7 ""KOI 7" K0i"4" '' K02 4 ~W2¥~'Wl 8"  K02 1~ 
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##  New  ADU  ##  INPUT  MESSAGE  #:  1 

ADU#:  1  |  TTI  IVEEj  ~~  (IPS): 08/18*/97  20:14:14  -  (ADAS  U_  0  8/18/  9720:14:14  |  msgs  3 

Hdr :  sim-TT  ADU  s i z e'i  ' 2 5 4  [Type :  I TW S 2~  Awos  j . ID:  KACY  |  OMO’s  =  0x03 

K  0  02  K  0  0  3  K  0  0 1 

##  New  ADU  ##  INPUT  MESSAGE  #:  10 

ADU#:  10  |  TIME  -  (IPS)  :  08/18/97  20:23:14  - . (ADAS)  : . 08/18/9720:23:14 . 1  msgs 

30  .  .  . 

Hdr:  Sim- 7  I  ADU  size:  2117  |  Type?  ITWS2  Awos  -|  ID:  •  KACY  I  -OMO's'  -  Oxle 
"'KOOT’k609"’kM7''k004’"Mi6’’"k005’  KOdi  koil  koi5  K006  K025  K019  K030  K002  K012 
~kdd8'  K0l6  K022  K026  KC2  9  K02C  KC13  KC23  K027  K017  KOI 4  KC24  K028  KOI 8  K02.1 _ 


##  New  ADU  ##  INPUT  MESSAGE  #:  1 

ADU# T""l""j . TIME"'- . (IPS)": . 08/1 8/97  20:14:14  -  (ADAS):  08/18/9720:14:14  |  msgs  3 

Hdr:  Sim-8  |  ADU  size:  254  |  Type:  ITWS3  Awos 1  ID:  KACY  |  OMO’s  =  0x03 
'  K002~K003  'KOdi . .  . " .  " . 


##  New  ADU  ##  INPUT  MESSAGE  #:  10 

APU#1  TO  TtIME  -  (IPS)  :  ~08/18~797  20:23:16  -  (ADAS):  08/18/9720:23:16  |  msgs 

30 

Hdr:  Sim-8  |  ADU  size:  2117  I  Type:  iTWS3  Awos  |  ID:  KACY  I  OMO’s  -  Oxle 
~koo3"'kM9""koo7'"k'oo4"''koi'o'X6o5"'kooi""koii  kdis  koo6  kb'2'5  koi9  k030  K002  K012 
K008  KOI 6  K022  K026  K029  K020  K013  K02 3 . JK02_7  K017  K014  K024  K028  K018  K021 _ 


##  New  ADU  ##  INPUT  MESSAGE  #:  1 

MU# :~T'"'T'”Tl"ME""_-'"'Tiks)":'"""687'r8/"97  20:14:  14  -  (ADAS)  :  08/18/9720:14:14  |  msgs  3 
Hdr:  Sim-  9  [  ADU  sizeTlIF  Type:'  ITWS4  Awos  j  ID:  KACY  I  OMO's  =  0x03 
K002  K003  KOOl 

##  New  ADU  ##  INPUT  MESSAGE  #:  10 

ADU# :  10  I  '“TIME  -  (IPS):  08/18/97  20:23: 17  -  (ADAS):  08/18/9720:23:17  |  msgs 

30“ . . . ■ . .  ’ 

Hdr:  Sim-9  I  ADU  size:  2117  |  Type:  ITWS4  Awos  |  ID:  KACY  |  OMO’s  =  Oxle 
'''kdd'3'’kdd9  kdd7'kdd4'kdro'kdd  K025  koi9  k030  kod2  K012 

K008  K 016"  K0 2 2  k02Tk029  k02d-k013"k023"  K027  K017  K014  K024  K028  K018  K021 


##  New  ADU  ##  INPUT  MESSAGE  #:  1 

ADUlfT””r""r"TIME""-"”Ti'P"s”rr"0"8/i8797  20:14:14  -  ( ADAS )  :  08/18/9720:14:14  I  msgs  3 
Hdr:  Sim-10  I  ADU  s"izeT"254 T  fypeTlTWSS  Awos  1  ~~ X D ;  KACY  j  OMO’s  «  0x03  • 

^^KOOOOOI . 

##  New  ADU  ##  INPUT  MESSAGE  #:  10 

ADU# i . 10 . TIME  - . (IPS) V  08/18/97  20:23: 17  -  (ADAS):  08/18/9720:23:  17  I  msgs 

30 

Hdr:  Sim- 10  |  ADU  size:  2117  |  Type:  ITWS5  Awos  |  ID:  KACY  |  OMO's  =  Oxle 
'■'kbb3'''kbb'9''kbb'7'’kbo'4'''kbi'b'''kbb5'''kobi'''kbii''''kbi5'''kbb6''kb25  kbi'9  k03d  ko'02  K012 
K008  KOI 6  K022  K026  K029  K020  K013  K023  K027  K017  K014  K024  K028  K018  K021 _ 


##  New  ADU  ##  INPUT  MESSAGE  #:  1 

MUyrT”"i~"Tiiffi""-””{i"PS")":""b87'r8"7"97  20:14:  14  -  (ADAS):  08/18/9720:14:14  I  msgs  3 
Hdr:  Sim- 11  1  ADU  size":""  2  54"  |  Type i"TWS6~  Awos  I  "iD:  KACY  I  OMO's  =  0x03 
K002  K003  KOOl 

##  New  ADU  ##  INPUT  MESSAGE  #:  10 

ADU#:  10  |  TIME  -  (IPS)':  08/18/97  20:23:18  -  (ADAS)  : . 08/18/9720:23:18  |  msgs 

30 

Hdr:  Sim-11  |  ADU  size:  2117  |  Type:  ITWS6  Awos  |  ID:  KACY  |  OMO's  =  Oxle 
. r . C-299 . 


K003  K009  K007  K0Q4  K010  K005  KOOl  KOll  K015  K006  K025  K019  K030  K002  K012 
K008  KOI 6  K022  K026  K02 9  K02 0 KO 1 3" K023 ^K027  K017 '  K014 

##  New  ADU  ##  INPUT  MESSAGE  #:  1 

ADU#:  1  |  TIME  -  (IPS):  08/18/97  20:14:05  -  (ADAS):  08/18/9720:14:05  |  msgs  3 

Hdr:  Sim-4  |  ADU  size:  209  j  Type :  "RWP ”Awos”~ T'’OMOrs"'=’’’3 . 

K002  K003  KOOl  . . . . . — . 


##  New  ADU  ##  INPUT  MESSAGE  #:  10 

AJU#:  10  |  TIME  -  (IPS):  08/18/97  20:23:07  -  (ADAS):  08/18/9720:23:07  |  msgs 

Hdr:  Sim-4  |  ADU  size:  2072  |  Type:  RWP  Awos  |  OMO's  =  30 

K009  K007  K004  K010  K005  KOOl  KOll  K015  K006  K025  K019  K030  K002  K012 
K008  KO 16  K022  K026  K02"9'' ''k020'' ^kdlT^ ^K023  ' Kd2'7' Kdl7''' 
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C.5.5  TEST  IT-05  -  ITWS  Interface 

The  following  paragraphs  provide  information  about  data  associated  with  this 
test  but  not  included  within  the  main  body  of  this  report. 


C.5.5.1  Associated  Evaluation  Criteria  and  Data 

The  following  Evaluation  Criteria  were  used  to  determine  the  requirements 
passed/ failed.  The  Cross  Reference  (CR)  numbers  can  be  used  to  trace  into  the 
data  found/referenced  below. 

Pass  Fail 

a.  [xx]  [  ]  Each  test  procedure  step's  "pass"  box,  in  the  'Observed 

Results'  column  is  marked,  indicating  the  'Expected 
Response'  was  observed  and/or  the  correct  action  was 
performed  successfully.  (See  Appendix  C  for  the  test 
procedures  performed  for  this  test) . 

b.  [XX]  [  ]  ADAS  shall  disseminate  surface  observations  to  ITWS  CR01 

NAS-SS-1000,  Section  4. 4. 1.4,  Vol  II  3 . 2 . 1 . 5 . 8 , 1 . 4  ISS2-001 

c.  [XX]  [  ]  ADAS  shall  disseminate  AWOS/ASOS  Messages  in  AWOS  format  to 

the  ITWS  once  pe  minute.  CR02  NAS-SS-1000,  Section _ 4_..4_.l 

Vol.  II  3. 2. 1.5. 8. 2. 4 -c  ISS2-1>0"2 . . 

d.  [XX]  [  ]  ADAS  shall  disseminate  current  LDD  Messages  to  each  ITWS  per 

5  second.  CR03  NAS-SS-1000,  ...Section . 4.4.1 .4, . Vol. . II 

3.2. 1.5. 8.2. 4 . 1-b  ISS2-003 . 

e.  [xx]  [  ]  ADAS  shall  disseminate  data  to  the  ITWS  via  the  NADIN  PSN. 

CR04  NAS-SS-1000,  Section  4. 4. 1.4, . Vol . . II . Figure 

3.2. 1 . 5TO-H"TSS2-004 . . 

f.  [XX]  [  ]  ADAS  shall  disseminate  current  LDD  Messages  to  ITWS  at  rate 

of  216  bits,  667  times/minute.  CR05  NAS-SS-1000,  Section 
4 . 4 . 1 . 4 ,  Vol .  1 1  Tab! e  3 . 2 . i . 5 . 8 ■ 3-T1 i 1  Tss2-005 

g.  [xx]  [  ]  ADAS  shall'  disseminate  data  Current  AWOS/ASOS  surface 

Weather  Observation  Messages  to  ITWS  at  rate  of  1.6KB,  137 

times/minute.  CR06  NAS-SS-1000,  Section . 4. 4. 1.4, . Vol. . II 

Table  3 . 2 . 1 . 5 . 0-Tl i~2 TSS2-006 . 


The  following  data,  marked  with  evaluation  criteria  cross  reference  numbers, 
is  a  subset  of  the  OT&E  formal  test  run  data.  Other  relavent  data  has  been 
included  into  test  IT-05' s  Test  Conduct  Form  (TCF)  file,  "IT-05. TCF". 

DATA  EXTRACTED  FROM  IPS  FILE 
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.  09-23-97  13:02:33  .  Events:  1 

.  Responses :  0 

.  Message  Output  Cmds 

•  • 

DISPLAY  INPUT  MESSAGE  LOG 


INPUT  MESSAGE:  2  CR01 

RECEIVE  TIME  (IPS):  09/23/97  12:46:17  CR02 
RECEIVE  TIME  (ADAS ): 09/23/97  12:46717 
SIMULATOR  ID:  6 

MESSAGE  TYPE:  ITWS1 . AWOS .MSG 

MESSAGE  SIZE:  3497  < - >CR06 

GROUP  ID:  18  - 

HEX  DUMP  OF  TEST  FILE: 
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1 

0 

1 

0 

1 

OUTPUT  MESSAGE  # 

: 

95 

TRANSMIT  TIME 

(IPS)  : 

09/23/97  12:46:04 

TRANSMIT  TIME 

(ADAS) 

:  09/23/97  12:46:04 

TIME  OFFSET: 

0 

STATION  ID: 

49 

MESSAGE  TYPE: 

ADAS  AWOS_MSG 

FILE  NAME: 

aw  msg/std 

FIELD  NUMBER: 

0 

FIELD  VALUE: 

FIELD  OFFSET: 

FIELD 

SIZE: 

0 

1 

0 

1 

0 

1 

OUTPUT  MESSAGE  # 

: 

96 

TRANSMIT  TIME 

(IPS)  : 

09/23/97  12:46:04 

TRANSMIT  TIME 

(ADAS) 

:  09/23/97  12:46:04 

TIME  OFFSET: 

0 

STATION  ID: 

56 

MESSAGE  TYPE: 

ADAS  AWOS  MSG 

FILE  NAME: 

aw  msg/std 

FIELD  NUMBER: 

0 

FIELD  VALUE: 

FIELD  OFFSET: 

FIELD 

SIZE: 

0 

1 

0 

1 

0 

1 

OUTPUT  MESSAGE  #: 

97 

TRANSMIT  TIME 

(IPS) i 

;  09/23/97  12:46:04 

TRANSMIT  TIME 

(ADAS  ) 

:  09/23/97  12:46:04 

TIME  OFFSET: 

0 

STATION  ID: 

53 

MESSAGE  TYPE: 

ADAS  AWOS  MSG 

FILE  NAME: 

aw  msg/std 

FIELD  NUMBER: 

0 

FIELD  VALUE: 

FIELD  OFFSET: 

FIELD 

SIZE: 

0 

1 
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OOO  ooo  ooo 


0 

1 

0 

0 

1 

0 

OUTPUT  MESSAGE  # 

• 

98 

TRANSMIT  TIME 

(IPS)  : 

09/23/97  12:46:0 4 

TRANSMIT  TIME 

(ADAS ) 

:  09/23797  12:46:04 

TIME  OFFSET: 

0 

STATION  ID: 

50 

MESSAGE  TYPE: 

ADAS  AWOS  MSG 

FILE  NAME: 

aw  msg/std 

FIELD  NUMBER: 

0 

FIELD  VALUE: 

FIELD  OFFSET: 

FIELD 

SIZE: 

0 

1 

0 

0 

1 

0 

0 

1 

0 

OUTPUT  MESSAGE  # 

: 

99 

TRANSMIT  TIME 

(IPS)  : 

09/23/97  12:46:04 

TRANSMIT  TIME 

(ADAS ) 

:  09/23/97  12:46:04 

TIME  OFFSET: 

0 

STATION  ID: 

57 

MESSAGE  TYPE: 

ADAS  AWOS  MSG 

FILE  NAME: 

aw  msg/std 

FIELD  NUMBER: 

0 

FIELD  VALUE: 

FIELD  OFFSET: 

FIELD 

SIZE: 

0 

1 

0 

0 

1 

0 

0 

1 

0 

OUTPUT  MESSAGE  # 

:  100 

TRANSMIT  TIME 

(IPS) : 

09/23/97  12:46:04 

TRANSMIT  TIME 

(ADAS) 

:  09/23/97  12:46:04 

TIME  OFFSET: 

0 

STATION  ID: 

54 

MESSAGE  TYPE: 

ADAS  AWOS  MSG 

FILE  NAME: 

aw  msg/std 

FIELD  NUMBER: 

0 

FIELD  VALUE: 

FIELD  OFFSET: 

FIELD 

SIZE: 

0 

1 

0 

0 

1 

0 

0 

1 

0 

DR  of  IT-05A.I1AW  for  messages/site  count. 


##  New  ADU  ##  INPUT  MESSAGE  #:  2 

l  09/23/97  12 :46:17- (ADAS):09/ 23/97  12:46:17  |  msqs  50 

Hdr:  Sim-6  |  ADU  size:  3497  |  Type:  ITWsi  Awos  j . 1 57  KACY  |  OMO ' s  =  0x32 

K011  K008  K003  K012  K005  K004  K009  K026  K015  K006  K020  K001  K030  K024  K010 

K027  K007  K017  K002  K031  K016  K021  K028  K050  K018  K047  K013  K032  K022  K025 

K019  K014  K029  K040  K023  K033  K049  K044  K037  K034  K041  K035  K038  K042  K036 

K048  K039  K043  K045  K046 
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DR  of  IT-05A.I2AW  for  messages/site  count. 


##  New  ADU  ##  INPUT  MESSAGE  #:  2 

ADU#:  2  |  (IPS):  09/23/97  12:46:14  -  (ADAS):  09/23/97  12:46:14  |  msgs  50 
Hdr:  Sim-7  |  ADU  size:  3497  |  Type:  ITWS2  Awos  |  ID:  KACY  |  OMO's  =  0x32 

K011  K008  K003  K012  K005  K004  K009  K026  K015  K006  K020  K001  K030  K024  K010 

K027  K007  K017  K002  K031  K016  K021  K028  K050  K018  K047  K013  K032  K022  K025 

K019  K014  K029  K040  K023  K033  K049  K044  K037  K034  K041  K035  K038  K042  K036 

K048  K039  K043  K045  K046 


DR  of  IT-05A. I3AW  for  messages/site  count. 


##  New  ADU  ##  INPUT  MESSAGE  #:  2 

ADU#:  2  I  (IPS):  09/23/97  12:46:18  -  (ADAS):  09/23/97  12:46:18  |  msgs  50 

Hdrl~~Si'm-8 . P’aDU  size: . 3497  j  Type:  ITWS3  Awos  |  ID:  KACY  |  OMO's  =  0x32 

K011  K008  K003  K012  K005  K004  K009  K026  K015  K006  K020  K001  K030  K024  K010 

K027  K007  K017  K002  K031  K016  K021  K028  K050  K018  K047  K013  K032  K022  K025 

KOI 9  K014  K029  K040  K023  K033  K049  K044  K037  K034  K041  K035  K038  K042  K036 

K048  K039  K043  K045  K046 


DR  of  IT-05A.I4AW  for  messages/site  count. 


##  New  ADU  ##  INPUT  MESSAGE  #:  2 

ADU#:  2  |  (IPS):  09/23/97  12:46:19  -  (ADAS):  09/23/97  12:46:19  I  ,msg_s.__5Q 
Hdr :  Sim- 9  f  ADU  si z e :  3497  |  Type:  ITWS4  Awos  |  ID:  KACY  I  OMO's  =  0x32 

K011  K008  K003  K012  K005  K004  K009  K026  K015  K006  K020  K001  K030  K024  K010 

K027  K007  K017  K002  K031  K016  K021  K028  K050  K018  K047  K013  K032  K022  K025 

K019  K014  K029  K040  K023  K033  K049  K044  K037  K034  K041  K035  K038  K042  K036 

K048  K039  K043  K045  K046 


DR  of  IT-05A.I5AW  for  messages/site  count. 


##  New  ADU  ##  INPUT  MESSAGE  #:  2 

ADU#:  2  I  (IPS):  09/23/97  12:46:12  -  (ADAS):  09/23/97  12:46:12  1  msgs__50 
Hdr:  Sim-10  I  ADU  size:  3497  |  Type:  iTWS5  Awos  I  ID:  KACY  I  OMO's  -  0x32 

K011  K008  K003  K012  K005  K004  K009  K026  K015  K006  K020  K001  K030  K024  K010 

K027  K007  K017  K002  K031  K016  K021  K028  K050  K018  K047  K013  K032  K022  K025 

K019  K014  K029  K040  K023  K033  K049  K044  K037  K034  K041  K035  K038  K042  K036 

K048  K039  K043  K045  K046 


DR  of  IT-05A.I6AW  for  messages/site  count. 


##  New  ADU  ##  INPUT  MESSAGE  #:  2 

ADU#:  2  j  (IPS)  :  09/23/97  12:46: 15  -  (ADAS):  09/23/97  12:46;  15  l...ms.gs.,  5Q 

HdrV-Sim-rr'r'  ADU'size: . 3497  j  Type:  ITWS6  Awos  |  ID:  KACY  |  OMO's  =  0x32 
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K011  K008  K003  K012  K005  K004  K009  K026  K015  K006  K020  K001  K030  K024  KOIO 
K027  K007  K017  K002  K031  K016  K021  K028  K050  K018  K047  K013  K032  K022  K025 
K019  K014  K029  K040  K023  K033  K049  K044  K037  K034  K041  K035  K038  K042  K036 
K04 8  K039  K043  K045  K046 


DATA  EXTRACTED  FROM  ADAS  FILE 
ADAS  COMMUNICATIONS  DATAPOINT: 


09-23-97  12:47:18 

.  Events:  0  .  Responses: 

0  . 

DATAPOINT  CMDS 

•  a  ' 

DISPLAY  NLDN  COMMUNICATIONS  LU  DATAPOINTS 

ALERT  ALARM 

DATAPOINT  NAME  ID  VALUE  CURR  PAST  CURR  PAST  LAST  RESET 


CONNECTION  STATUS: 
12:44:28 

NLDN  FAILURES  TOTAL: 
12:44:28 

ERROR  DETECTED: 
12:44:28 

ERROR  DETECTED  TOTAL: 
12:44:28 


ALERT  THRESHOLDS  .  ALARM  THRESHOLDS 

UPPER  LOWER  ENAB  UPPER  LOWER  ENAB 

-!  -1  YES  -1  2  YES 


ITWS1 


09  23  97  12:'47:40  .  Events:  0  .  Responses:  0  ..  DATAPOINT  CMDS  | 


01  CFG- ACTIVE 
02  0 

03  0 

04  0 


09-23-97 

09-23-97 

09-23-97 

09-23-97 


DISPLAY  I TWS  COMMUNICATION  LU  DATAPOINTS 

ALERT  ALARM 

DATAPOINT  NAME  ID  VALUE  CURR  PAST  CURR  PAST  LAST  RESET 


CONNECTION  STATUS: 
12:44:28 

01 

CFG-ACTIVE 

09-23-97 

AWOS  MESSAGES  SENT: 
12:44:28 

02 

100 

09-23-97 

AWOS  ADU  MSGS  SENT: 
12:44:28 

03 

2 

09-23-97 

LDD  MESSAGES  SENT: 
12:44:28 

04 

151 

09-23-97 
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LDD  ADU  SENT: 
12:44:28 

05 

ALERT 

THRESHOLDS 

UPPER 

LOWER 

ENAB 

-1 

-1 

YES 

26 

09-23- 

ALARM  THRESHOLDS 

UPPER  LOWER 

ENAB 

-1  2 

YES 

ITWS2 


09-23-97  12:47:52 

.  Events 

0  .  Responses: 

0  . 

DATAPOINT  CMDS 

• 

DISPLAY  ITWS  COMMUNICATION  LU  DATAPOINTS 

ALERT 

ALARM 

DATAPOINT  NAME 

ID  VALUE 

CURR  PAST 

CURR  PAST 

LAST  RESET 

CONNECTION  STATUS: 

01 

CFG-ACTIVE 

09-23-97 

12:44:28 

AWOS  MESSAGES  SENT: 

02 

100 

09-23-97 

12:44:28 

AWOS  ADU  MSGS  SENT: 

03 

2 

09-23-97 

12:44:28 

LDD  MESSAGES  SENT: 

04 

151 

09-23-97 

12:44:28 

LDD  ADU  SENT: 
12:44:28 

05 

26 

09-23-97 

ALERT  THRESHOLDS 
UPPER  LOWER 

-1  -1 

ENAB 

YES 

UPPER 

-1 

ALARM  THRESHOLDS 

LOWER  ENAB 

2  YES 

ITWS  3 

09-23-97  12:48:04 

.  Events 

: 

2  .  Responses: 

0  . 

DATAPOINT  CMDS 

DISPLAY  ITWS  COMMUNICATION  LU  DATAPOINTS 
. : . . . ALERT  ALARM 

DATAPOINT  NAME  ID  VALUE  CURR  PAST  CURR  PAST  LAST  RESET 


CONNECTION  STATUS: 

01 

CFG-ACTIVE 

09-23-97 

44:28 

AWOS  MESSAGES  SENT: 

02 

100 

09-23-97 

44:28 

AWOS  ADU  MSGS  SENT: 

03 

2 

09-23-97 

44:28 

LDD  MESSAGES  SENT: 

04 

151 

09-23-97 

44:28 

LDD  ADU  SENT: 

05 

26 

09-23-97 

:  44 : 28 

ALERT  THRESHOLDS 
UPPER  LOWER 

ENAB 

ALARM  THRESHOLDS 
UPPER  LOWER 

ENAB 
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-1  YES  -1  2  YES 


ITWS4 


.  09-23-97  12:48:18  .  Events: 

3  .  Responses: 

0  . 

DATAPOINT  CMDS 

DISPLAY  ITWS  COMMUNICATION  LU  DATAPOINTS 
. ALERT  ALARM 

DATAPOINT  NAME  ID  VALUE  CURR  PAST  CURR  PAST  LAST  RESET 


CONNECTION  STATUS: 

12:44:28 

AWOS  MESSAGES  SENT: 

12:44:28 

AWOS  ADU  MSGS  SENT: 

12:44:28 

LDD  MESSAGES  SENT: 

12:44:28 

LDD  ADU  SENT: 

12:44:28 

ALERT  THRESHOLDS  ALARM  THRESHOLDS 


UPPER 

LOWER 

ENAB 

UPPER 

LOWER 

ENAB 

-1 

-1 

YES 

-1 

2 

YES 

ITWS  5 


09-23-97  12:48:31 

.  Events : 

3  .  Responses: 

0  . 

DATAPOINT  CMDS 

•  • 

DISPLAY  ITWS  COMMUNICATION  LU  DATAPOINTS 

ALERT  ALARM 

DATAPOINT  NAME  ID  VALUE  CURR  PAST  CURR  PAST  LAST  RESET 


CONNECTION  STATUS:  01  CFG-ACTIVE 

12 : 44 : 28 

AWOS  MESSAGES  SENT:  02  150 

12:44:28 

AWOS  ADU  MSGS  SENT:  03  3 

12:44:28 

LDD  MESSAGES  SENT:  04  212 

12:44:28 

LDD  ADU  SENT:  05  37 

12:44:28 

ALERT  THRESHOLDS  ALARM  THRESHOLDS 

UPPER  LOWER  ENAB  UPPER  LOWER  ENAB 

-1  -1  YES  -1  2  YES 

ITWS  6 


09-23-9.7  | 

09-23-97 

09-23-97 

09-23-97 

09-23-97 


01  CFG-ACTIVE  09-23-97  | 

02  150  09-23-97 

03  3  09-23-97 

04  212  09-23-97 

05  37  09-23-97 
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09-23-97  12:49:07  .  Events:  5  .  Responses:  0  .  DATAPOINT  CMDS  | 


DISPLAY  ITWS  COMMUN I CAT I ON  LU  DATAPOINTS  | 

. . ""alert  alarm 

DATAPOINT  NAME  ID  VALUE  CURR  PAST  CURR  PAST  LAST  RESET 

09-23-97  | 


09-23-97 

09-23-97 

09-23-97 

09-23-97 


ALARM  THRESHOLDS 
UPPER  LOWER  ENAB 

-1  2  YES 


ADAS  EVENT  LOG: 

EVENT  PRIORITY:  non-critical  DATE/TIME  STAMP:  09-23-97  12:38:43 
EVENT  SEQ.  NUMBER:  44  EVENT  TYPE:  61  CSC  ID:  21.01 

Status  of  the  ITWS  connection  has  changed. 

site  id:  1001 

comm  status:  enabled- failed 

EVENT  PRIORITY:  non-critical  DATE/TIME  STAMP:  09-23-97  12:38:43 
EVENT  SEQ.  NUMBER:  45  EVENT  TYPE:  61  CSC  ID:  21.01 

Status  of  the  ITWS  connection  has  changed. 

site  id:  1002 

comm  status:  enabled-failed 

EVENT  PRIORITY:  non-critical  DATE/TIME  STAMP:  09-23-97  12:38:43 
EVENT  SEQ.  NUMBER:  46  EVENT  TYPE:  61  CSC  ID:  21.01 

Status  of  the  ITWS  connection  has  changed. 

site  id:  1003 

comm  status:  enabled-failed 

EVENT  PRIORITY:  non-critical  DATE/TIME  STAMP:  09-23-97  12:38:43 
EVENT  SEQ.  NUMBER:  47  EVENT  TYPE:  61  CSC  ID:  21.01 

Status  of  the  ITWS  connection  has  changed. 

site  id:  1004 

comm  status:  enabled-failed 

EVENT  PRIORITY:  non-critical  DATE/TIME  STAMP:  09-23-97  12:38:44 
EVENT  SEQ.  NUMBER:  48  EVENT  TYPE:  61  CSC  ID:  21.01 

Status  of  the  ITWS  connection  has  changed. 


CONNECTION  STATUS: 
12:44:28 

AWOS  MESSAGES  SENT: 
12:44:28 

AWOS  ADU  MSGS  SENT: 
12:44:28 

LDD  MESSAGES  SENT: 
12:44:28 

LDD  ADU  SENT: 
12:44:28 


01  CFG- ACTIVE 


ALERT  THRESHOLDS 
UPPER  LOWER 

-1  -1 
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site  id:  1005 

comm  status:  enabled-f ailed 

EVENT  PRIORITY:  non-critical  DATE/TIME  STAMP:  09-23-97  12:38:48 
EVENT  SEQ.  NUMBER:  49  EVENT  TYPE:  61  CSC  ID:  21.01 

Status  of  the  ITWS  connection  has  changed. 

site  id:  1006 

comm  status:  enabled-f ailed 

EVENT  PRIORITY:  non-critical  DATE/TIME  STAMP:  09-23-97  12:44:20 
EVENT  SEQ.  NUMBER:  56  EVENT  TYPE:  61  CSC  ID:  21.01"“'  "  ■ — 

Status  of  the  ITWS  connection  has  changed. 

site  id:  1004 

comm  status:  enabled-active 

EVENT  PRIORITY:  non-critical  DATE/TIME  STAMP:  09-23-97  12:44:21 

EVENT  SEQ.  NUMBER:  58  EVENT  TYPE:  61  CSC  ID:  21.01 . " . . . 

Status  of  the  ITWS  connection  has  changed. 

site  id:  1005 

comm  status:  enabled-active  " 


EVENT  PRIORITY:  non-critical  DATE/TIME  STAMP:  09-23-97  12:44:23 

EVENT  SEQ.  NUMBER:  60  EVENT  TYPE:  61  CSC  ID:  21.01 . ■ . 

Status  of  the  ITWS  connection  has  changed. 

site  id:  1001 

comm  status:  enabled-active 

EVENT  PRIORITY:  non-critical  DATE/TIME  STAMP:  09-23-97  12:44:25 

EVENT  SEQ.  NUMBER:  62  EVENT  TYPE:  61  CSC  ID:  21.01 . 

Status  of  the  ITWS  connection  has  changed. 

site  id:  1006 

comm  status :  enabled-active 

EVENT  PRIORITY:  non-critical  DATE/TIME  STAMP:  09-23-97  12:44:26 
EVENT  SEQ.  NUMBER:  63  EVENT  TYPE:  61  CSC  ID:  21.01~~ 

Status  of  the  ITWS  connection  has  changed. 

site  id:  1002 

comm  status:  enabled-active 

EVENT  PRIORITY:  non-critical  DATE/TIME  STAMP:  09-23-97  12:44:29 

EVENT  SEQ.  NUMBER:  69  EVENT  TYPE:  61  CSC  ID:  21.01 . 

Status  of  the  ITWS  connection  has  changed. 

site  id:  1003 

comm  status:  enabled-active 

EVENT  PRIORITY:  non-critical  DATE/TIME  STAMP:  09-23-97  12:56:27 
EVENT  SEQ.  NUMBER:  1457  EVENT  TYPE:  61  CSC  ID:  21.01 

Status  of  the  ITWS  connection  has  changed. 

site  id:  1006 

comm  status:  enabled- failed 
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EVENT  PRIORITY:  non-critical  DATE/TIME  STAMP:  09-23-97  12:56:31 
EVENT  SEQ.  NUMBER:  1458  EVENT  TYPE:  61  CSC  ID:  21.01 

Status  of  the  ITWS  connection  has  changed. 

site  id:  1005 

comm  status:  enabled-f ailed 

EVENT  PRIORITY:  non-critical  DATE/TIME  STAMP:  09-23-97  12:56:40 
EVENT  SEQ.  NUMBER:  1462  EVENT  TYPE:  61  CSC  ID:  21.01 

Status  of  the  ITWS  connection  has  changed. 

site  id:  1003 

comm  status:  enabled- failed 

EVENT  PRIORITY:  non-critical  DATE/TIME  STAMP:  09-23-97  12:56:44 
EVENT  SEQ.  NUMBER:  1464  EVENT  TYPE:  61  CSC  ID:  21.01 

Status  of  the  ITWS  connection  has  changed. 

site  id:  1001 

comm  status:  enabled- failed 

EVENT  PRIORITY:  non-critical  DATE/TIME  STAMP:  09-23-97  12:56:48 
EVENT  SEQ.  NUMBER:  1466  EVENT  TYPE:  61  CSC  ID:  21.01 

Status  of  the  ITWS  connection  has  changed. 

site  id:  1004 

comm  status:  enabled-failed 

EVENT  PRIORITY:  non-critical  DATE/TIME  STAMP:  09-23-97  12:56:51 
EVENT  SEQ.  NUMBER:  1467  EVENT  TYPE:  61  CSC  ID:  21.01 

Status  of  the  ITWS  connection  has  changed. 

site  id:  1002 

comm  status:  enabled-failed 

EVENT  PRIORITY:  non-critical  DATE/TIME  STAMP:  09-23-97  12:44:31 
EVENT  SEQ.  NUMBER:  70  EVENT  TYPE:  62  CSC  ID:  22.01 

Status  of  the  NLDN  connection  has  changed. 

comm  status:  enabled-active 


C-339 
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C.5.6.  TEST  IT-06  -  Recoverable  I/O  Init.  Error  (ITWS) 

The  following  paragraphs  provide  information  about  data  associated  with  this 
test  but  not  included  within  the  main  body  of  this  report. 


C.5.6.1.  Associated  Evaluation  Criteria  and  Data 

The  following  Evaluation  Criteria  were  used  to  determine  the  requirements 
passed/failed.  The  Cross  Reference  (CR)  numbers  can  be  used  to  trace  into  the 
data  found/referenced  below. 

Pass  Fail 

]  Each  procedure  step's  "pass"  box,  in  the  ’Observed  Results1 
column,  was  marked,  indicating  the  'Expected  Response’  was 
observed.  (See  Appendix  C  for  the  test  procedure  performed 
for  test  IT-06. ) 

]  The  ADAS  Event  Log  must  show  that  ADAS  detected  the  off-line 
ITWS  Simulator  CR1  and  continued  to  the  Operational  State  -  j 
Reduce  Mode  as  indicated  by  the  SYS_MODE  datapoint  (LU  20  DP 
02)  in  the  Datapoint  request  CR2*.  I 

]  After  communication  was  enabled,  the  ITWS  simulator  must  be 
reported  as  active  CR3 .  I 

]  The  transition  from  Reduce  to  Full  Mode  must  have  occurred 
as  indicated  by  the  third  request  of  the  SYS_MODE  datapoint 
(LU  20  DP  02)  CR4 ' .  * 

*  The  time  stamps  shown  on  the  datapoint  messages  indicates  when  it  was 
retrieved  and  not  when  the  datapoint  changed  value. 

The  following  data,  marked  with  evaluation  criteria  cross-reference  numbers., 
is  a  subset  of  the  OT&E  formal  test  run  data.  Other  relavent  data  has  been 
included  into  IT-06' s  Test  Conduct  Form  (TCF)  file,  "IT-06. TCF" . 

EVENT  PRIORITY:  non-crltlcal  • DATE/TIME  'STAMP:  08-19-97  18 {09: 16 

EVENT  S  EQ NUMBER :  45  _  EVENT  TYPE:  61 _ CSC  ID:  21.01 

Status  of  the  ITWS  connection _  has i_changed_._ 

site  id:  1001 

comm  status:  enabled- failed 

EVENT  PRIORITY:  non-critical DATE/TIME  STAMP;  08-19-97  18:09:16. 

EVENT  ^SEQ.  NUMBER: . 46  EVENT  TYPE:  61 . ; CSC  ID:  21.01 

Status  of  the  ITWS  connection  has  changed. 


a.  [XX]  [ 

b.  [XX]  [ 

c.  [XX]  [ 

d.  [XX]  [ 


site  id:  1002 

comm  status:  enabled-failed 


C-347 


15^NT...JPRipRITY :  non-critical  DATE/TIME  STAMP:  08-19-97  18:09:17 

EVENT"  SEQ .  NiMBER:  47 . EV^NT''  TYPE'r"6i . . . CSC"‘YdT' 2l7oT . . . 

Status  of  the  ITWS  connection  has  changed. 

site  id:  1003 

. comm  status:  enabled- failed 

EVENT  PRIORITY:  non-critical  DATE/TIME  STAMP:  08-19-97  18:09:17 

EVENT  SEQ. ""NUMBER:  4 <8  EVENT"TYPE'r'6r . CSCTdT'TOI 

the  ITWS  connection  has  changed. 

site  id:  1004 

. comm  status :  enabled- failed 

EVENT  PRIORITY:  non-critical  DATE/TIME  STAMP:  08-19-97  18:09:17 
EVENT  SEQ.  NUMBER:  49 EVENT  TYPE:  61  CSC  ID:  21.01 

.?.t?tus  _of  the  ITWS  connection  has  changed. 

_ site  id:  1005 

comm  status:  enabled-failed 

EVENTPRIORITY :  non-critical  DATE/TIME  STAMP:  08-19-97  18:09:21 

EVENT  SEQ.  NUMBER: "'50 . EVENT" TYPe7"'61 “cSC"'iDT'TOl . ™ 

the  ITWS  connection  has  changed. 

site  id:  1006 

_ comm  status:  enabled-failed 

..PRIORITY:  non-critical  DATE/TIME  STAMP:  08-19-97  18:11:22 

EVENT  SEQ.  NUMBER:  '25  3  EVENT  TYPE:  61  CSC  I D :  2 1 7 0 1 . 

Status  of  the  ITWS__connection  has  changed. 

site  id:  1005 

. comm  status :  enabled-active 

EVENT  PRIORITY:  non-critical  DATE/TIME  STAMP:  08-19-97  18:11:25 

EVENT  SEQ.  NUMBER:  -254 . EVENT  TYPE: . 61  CSC  ID:  21.01 

of  the  ITWS  connection  has  changed. 

_ site  id:  1001 

. comm  status:  enabled-active 

EVENT  PRIORITY:  non-critical  DATE/TIME  STAMP:  08-19-97  18:11:26 

EVENT  SEQ.  NUMBER:  255 . EVENT  TYPE :  "61  . CSCTYd :  ~2  lTO  1 . 

the  ITWS  connection  has  changed. 

site  id:  1006 

comm  status:  ena bled-active 

EVENT  PRIORITY:  non-critical  DATE/TIME  STAMP:  08-19-97  18:11:27 

EVENT  SEQ .  NUMBER:" “"256 """event'"tyPE:''''6T . CSC"“fD T~2 lT6 T . 

Status  of  the  ITWS  connection  has  changed . 

site  id:  1002 

comm  status:  enabled-active 

EVENT  PRIORITY:  non-critical  DATE/TIME  STAMP:  08-19-97  18:11:30 

EVENT  SEQ.  NUMBER:  257 . 'EVnBOT'"TYPE:~'6i . “cSC'lD:"“2Trpi . : . 

. . C-348 . 


Status  of  the  ITWS  connection  has  .changed. 

_ site  id :  1003 

comm  status:  enabled- active 


EVENT  PRIORITY:  non-critical  DATE/TIME  STAMP:  08-19-97  18:11:33 

EVENT SEQ. "NUMBER : ""258"  '  EVENT  TYPE:  61 _ CSC  ID:  21.01 

Status  of  the  ITWS  connection  has  changed. 


site  id:  1004 

comm  status:  enabled-active 


INPUT  MESSAGE  #:  . . 158 

. RECEIVE  TIME  (ADAS ) :  08/19/97  18:11:16 


21378  ‘  RMS  TdT  . .  0x01 . ; . 

21380 . DATE: .  08/19/97 . 

21382 . DATAPOI NT  ID: . 0x02 . 

21384  . PARAMETER  6/ALU E : . (001)  Decimal 


LOGICAL  UNIT  ID: 

TIME: . . . . 

CONDITION  STATUS : 


0x20 

18:11:16 

0x42 


CR2 


INPUT  MESSAGE  #: 

RECEIVE  TIME  (ADAS): 

159 

08/19/97  18:12:16 

LOGICAL  UNIT  ID: 

0x20 

+++++- 

21398 

!-  +  +  +++  +  +  +  +  +++  +  +  +  + 
RMS  ID: 

+++- 

0x01 

21400 

DATE : 

08/19/97 

TIME: 

18:12:16 

21402 

DATAPOINT  ID: 

0x02 

CONDITION  STATUS: 

0x40 

21404 

PARAMETER  VALUE: 

(000)  Decimal 

CR3 
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C.6.  CATEGORY  MP  -  Maintenance  Processing  Tests 

Testing  of  ADAS's  Remote  Monitoring  Subsystem  (RMS)  was  performed  by  the  MPS 
group,  ACT-330.  Refer  to  the  MPS  group's  test  report,  included  as  Appendix  D 
to  this  report. 


C.7.  CATEGORY  OP  -  Operational  Tests 


C.7.1.  TEST  OP-01  -  ADAS  Startup/Shutdown 

The  following  paragraphs  provide  information  about  data  associated  with  this 
test  but  not  included  within  the  main  body  of  this  report. 


C.7.1. 1.  Associated  Evaluation  Criteria  and  Data 

>r 

The  following  Evaluation  Criteria  were  used  to  determine  the  requirements 
passed/failed.  The  Cross  Reference  (CR)  numbers  can  be  used  to  trace  into  the 
data  found/referenced  below. 

Pass  Fail 

a>  [XX]  t  ]  Each  procedure  step's  "pass"  box,  in  the  'Observed  Results' 

column,  was  marked,  indicating  the  'Expected  Response'  was 
observed.  (See  Appendix  C  for  the  test  procedure  performed 
for  test  OP-01. ) 

k’  .[XX]  [  ]  ADAS  must  achieve  a  successful  uninterrupted  startup  CR1A  & 

CRIB. 


ADAS  must  then  be  shutdown  CR2A  &  CR2B . 


ADAS  must  progress  from  restart  CR3  to  control  by  the 
specialist  during  the  initialization  state  CR4A  -  CR4D . 

The  ADAS  Event  log  must  contain  the  Event  indicating  ADAS 
was  commanded  to  shutdown  CR5. 

Normal  ADAS  shutdown  was  indicated  by  no  event  type  42  (CSC 
Error)  events  after  the  shutdown  request. 


The  following  data,  marked  with  evaluation  criteria  cross-reference  numbers, 
is  a  subset  of  the  OT&E  formal  test  run  data.  Other  relavent  data  has  been 
included  into  OP-01 's  Test  Conduct  Form  (TCF)  file,  "OP-01 . TCF" . 


c.  [XX]  [  ] 

d.  [XX]  [  ] 

e.  [XX]  [  ] 

f.  [XX]  [  ] 
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Run  2  -  PASSED: 


PTR  OTE-Oll  fix  verified. 


EVENT  PRIORITY:  normal  DATE/TIME  STAMP:  01-05-98  15:54:25 

EVENT  SEQ.  NUMBER:  258  EVENT  TYPE:  20 . CSC  ID:  14.01 

ADAS  specialist  has  issued  a  command  request. 

_  jyjecia list  cmd :  [LOGON] . . . . . . . . . . . 

EVENT  PRIORITY:  normal  DATE/TIME  STAMP:  01-05-98  15:54:30 

EVENT  SEQ.  NUMBER:  260  EVENT  TYPE:  20 . .CSC  .ID:  14.01 

ADAS  specialist  has  issued  a  command  reguest. 

specialist  cmd:  [ADMIN  CMDS]  -  SHUTDOWN  ADAS . ' . 


EVENT  PRIORITY:  normal  DATE/TIME  STAMP:  01-05-98  15:54:31 

EVENT  SEQ.  NUMBER:  261  EVENT  TYPE:  39 _ CSC  ID:  13.02 

A  system  state  change  has  occurred. 

state:  operational _ 


EVENT  PRIORITY:  non-critical  DATE/TIME  STAMP:  01-05-98  15:54:31 
EVENT  SEQ.  NUMBER:  262  EVENT  TYPE:  14 . ; . CSC  ID;  10.01 

A  Return  To  Normal/State  Change  con^  by  maint.  datapoints 


logical  unit:  RMS  Master dp  item:  ADAS  system  state 
message  function:  State  Change  stapus:  Normal 
lHrtrated"byr'ADAS  Maintenance  Phase  value:  shutdown 


EVENT  PRIORITY:  normal  DATE/TIME  STAMP:  01-05-98  15:56:13 

EVENT  SEQ.  NUMBER:  377  EVENT  TYPE:  3 9 . CSC  ID] ,13 ,. 02 

A  system  s tate  chan ge  ha s  occurred. 

state :  initialization-start . ;. 

EVENT  PRIORITY:  normal  DATE/TIME  STAMP:  01-05-98  15:56:13 

EVENT  SEQ.  NUMBER:  37  8  EVENT  TYPE:  34 . CSC  ID:  13.02 

Specialist  logon  is  now  permitted. . . . . . 


JCR3 

(|r4A 


EVENT  PRIORITY:  normal  DATE/TIME  STAMP:  01-05-98  15:56:19 

EVENT  SEQ.  NUMBER:  47  0  EVENT  TYPE:  20 _ . _ CSC  ID:  14.01 

ADAS  specialist  has  issued  a  command  reguest. 

specialist  cmd:  [LOGON]  _  _ _ _ _ _ 

EVENT  PRIORITY:  normal  DATE/TIME  STAMP:  01-05-98  15:57:20 

EVENT  SEQ.  NUMBER:  487  EVENT  TYPE:  20 . CSC  ID:  .14.01 

ADAS  specialist  has  issued  a  command  request. 

specialist  cmd:  f EDIT JjjORKING  ADAPT]  -  CMN  WTHR  PARAMS . . 
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EVENT  PRIORITY:  normal  DATE/TIME  STAMP:  01-05-98  15:57:29 

EVENT  SEQ.  NUMBER:  489  EVENT  TYPE:  20  CSC  ID:  14.01 

ADAS  specialist  has  issued  a  command  request.' . 

. specialist  cmd: . [ADAPT  CMDS]  -  INSTALL  WORKING  ADAPT  C  R4 D 

EVENT  PRIORITY:  normal  DATE/TIME  STAMP:  01-05-98  15:58:39 

EVENT  SEQ.  NUMBER:  505  EVENT  TYPE:  20  CSC  ID:  14.01 

a  command  request. 

specialist  cmd:  [ADMIN  CMDS]  -  SHUTDOWN __ADAS _ _  CR5 
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14.  Set  the  VISIBILITY  THRESHOLD  J1  field  to  1.5.  The  field  must  be  updated  with  the  new  [X]  Pass  [  ]  Fail  Stop  Test 

@ASC:  "<5 : [DOWN] >  150  [RTN] "  value. 


TEST  #  OP-01  TESTED  BY:  _  Jock  K.  Stratton  _  DATE:  05/JAN/98  TIME:  15:48  TEST  DIRECTOR’S  INITIALS 
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29.  Select  log  for  Start  s  End  recorded  above.  The  Event  Log  selection  is  output,  (X]  Pass  [  ]  Fail  Stop  Test 

@ASC:  "[DOWN]  [Start  Time)  [RTN]  [DOWN]  [End  the  response  window  is  displayed  & 
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C.7.2.  TEST  OP-02  -  Restart  (Auto  -  Overall  Warm) 

The  following  paragraphs  provide  information  about  data  associated  with  this 
test  but  not  included  within  the  main  body  of  this  report. 


C.7.2.1.  Associated  Evaluation  Criteria  and  Data 

The  following  Evaluation  Criteria  were  used  to  determine  the  requirements 
passed/ failed .  The  Cross  Reference  (CR)  numbers  can  be  used  to  trace  into  the 


data 

found/referenced  below. 

Pass 

Fail 

a . 

[XX] 

[  ] 

Each  procedure  step's  "pass"  box,  in  the  'Observed  Results' 
column,  was  marked,  indicating  the  'Expected  Response'  was 
observed.  (See  Appendix  C  for  the  test  procedure  performed 
for  test  OP-02  . ) 

b. 

[XX] 

[  ] 

The  status  datapoints  information  returned  from  ADAS  must 
show  that  the  "startup"  datapoint  indicates  a  warm  start 
overall  CR1 .  | 

c. 

[XX] 

[  ] 

The  METAR  generation  datapoint  must  indicate  that  three 
Specials  were  generated  CR2 .  j 

d. 

[XX] 

[  ] 

The  METAR  message  arriving  at  WMSCR  after  the  warm  start 
must  contain  the  thunder  storm  begin  additive  data  CR3 

(before  example)  &  CR4  (after) . 

The  following  data,  marked  with  evaluation  criteria  cross-reference  numbers, 
is  a  subset  of  the  OT&E  formal  test  run  data.  Other  relavent  data  has  been 
included  into  OP-02' s  Test  Conduct  Form  (TCF)  file,  "OP-02. TCF". 


INPUT  MESSAGE  #:  158 

RECEIVE  TIME  (ADAS):  03/17/98  18:56:33 


21378  RMS  ID:  0x01 

21380  DATE: _  03/17/98 

21392  DATAPOINT  f6T~ '.0x03  ~ 

213  94  P ARftMETE  R '' VALUE : . (0*00)"' ’Decimal" 


LOGICAL  UNIT  ID: 

TIME': . 

CONDITION'  ' STATU S : 


0x20 

18:34: 3  3 
0x40 


CR1 


INPUT  MESSAGE  #:  159 

RECEIVE  TIME  (ADAS):  03/17/98  18:56:33 


22163  RMS  ID:  0x01 

22165  DATE:  03/17/98 

22182 . DATAPOINT  ID:  0x04 

22184  PARAMETERVALUE: . TOOOOOOOOT) 


LOGICAL  UNIT  ID: 

_ TIME': . 

. CONDITION  STATU Sj 

Decimal 


0x26 

18:34:33 
0x4  0 


CR2 


03/17/98  18:30:04 


C-358 


SPECI  K001  171830Z  AUTO  04005G15KT  7SM  R01/3000FT  TS  22/06  A2998  RMK 

AO 2  TSB30  SLP000  . /  '  . . . ■ . . . . I.?.?.?. 

03/17/98  18:34:04 

SPECI  K001  171834Z  AUTO  04005G15KT  2SM  R01/3000FT  OVCIOO  22/06  A2998  ( 

RMK  AO 2  TSB30  SLP000  PWINO  FZRANO  .  . . . . . 1?.M 
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"ADAS  is  DOWN'  message  and  the  acknowledge  the  The  child  death  messages  appear  at  the 
ISI  event.  AOC,  followed  by  'ADAS  is  DOWN'  an 

@ISI:  "<2:[F14]>  [F6]  {wait}  [F7]"  auto-restart. 

@AUC :  " [RTN]  {wait}" 

@ISI:  "[F7]”  The  Event  Window  disappears. 


TEST#  OP-02  TESTED  BY:  _ JockK.  Stratton _  DATE:  28/AUG/97  TIME:  22:38  TEST  DIRECTOR'S  INITIALS 
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C.7.3.  TEST  OP-03  -  Restart  (Auto  Cold  Start) 

The  following  paragraphs  provide  information  about  data  associated  with  this 
test  but  not  included  within  the  main  body  of  this  report. 


C.7.3.1.  Associated  Evaluation  Criteria  and  Data 

The  following  Evaluation  Criteria  were  used  to  determine  the  requirements 
passed/ f ailed .  The  Cross  Reference  (CR)  numbers  can  be  used  to  trace  into  the 
data  found/referenced  below. 


Pass  Fail 

[XX]  [  ]  Each  procedure  step's  "pass"  box,  in  the  'Observed  Results' 
column,  was  marked,  indicating  the  'Expected  Response'  was 
observed.  (See  Appendix  C  for  the  test  procedure  performed 
for  test  OP-03 . ) 

[XX]  [  ]  The  initialization  mode  datapoint  must  indicate  an  overall 

Cold  Start  occurred  CR1.  | 

[XX]  [  ]  The  METAR  special  generation  datapoint  must  indicate  one 

less  than  the  total  number  of  METAR  specials  generated  CR2 .  | 

[XX]  [  ]  Any  METAR  messages  arriving  at  the  WMSCR  simulator  after  the 

shutdown  must  not  contain  the  thunder  storm  begin  additive 
data  CR3  (before)  &  CR4  (after) .  I 


The  following  data,  marked  with  evaluation  criteria  cross-reference  numbers, 
is  a  subset  of  the  OT&E  formal  test  run  data.  Other  relavent  data  has  been 
included  into  OP- 03 's  Test  Conduct  Form  (TCF)  file,  "OP-03 . TCF" . 


INPUT  MESSAGE  #:  158 

RECEIVE  TIME  (ADAS):  08/28/97  23:10:29 

21378  RMS  ID:  0x01 

21380  DATE: _ 08/28/97 _ 

21392  DATAPOINT  ID: _  0x03 

21394  PARAMETER  VALUE:'"  "  ( 003)  "Decimal" 


LOGICAL  UNIT  ID: 

TIME': . 

CONDITION  STATUS: 


0x20 

23:10:31 

0x40 


INPUT  MESSAGE  #:  159 

RECEIVE  TIME  (ADAS):  08/28/97  23:10:30 


22163  RMS  ID:  0x01  ] 

22165  DATE:  08/28/97  'i 

22182  DATAPOINT  ID:  0x04  C 

22184 PARAMETER  VALUE": '”(' '0"00"6"0000r)""'Decimal” 


LOGICAL  UNIT  ID: 
TIME:" 

CONDITION  STATUS: 


0x26 

23:10:33 
0x4  0 


21  1  SPECI  K001  282305Z  AUTO  04005G15KT  7SM  R01/3000FT  TS  22/06  A2998  RMK 


C-362 


22  1 


AO 2  TSB05  SLPOOO 


jCR3 


47  2  SPECI  KOOl  282310Z' AUTO  04005G15KT  2SM  R01/3000FT  OVCIOO  22/06  A2998 

48  2  RMK  A02_SLP000  _ _ _  jgM 


C-363 


C.7.3.2.  TCF  Test  Procedure  Steps 
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11.  When  the  IPS  test  terminates,  shutdown  ADAS  The  ADAS  shuts  down.  [X]  Pass  [  ]  Fail  Stop  Test 

@AUC  'adas'  prompt:  enter  'stop_adas' 


TEST  #  OP-03  TESTED  BY:  _  Jock  K.  Stratton  _  DATE:  28/AUG/97  TIME:  23:01  TEST  DIRECTOR’S  INITIALS 
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C.7.4.  TEST  OP-04  -  Restart  (Auto  Warm  Start  -  Maint) 

The  following  paragraphs  provide  information  about  data  associated  with  this 
test  but  not  included  within  the  main  body  of  this  report. 


C.7.4.1.  Associated  Evaluation  Criteria  and  Data 

The  following  Evaluation  Criteria  were  used  to  determine  the  requirements 
passed/failed.  The  Cross  Reference  (CR)  numbers  can  be  used  to  trace  into  the 
data  found/referenced  below. 

Pass  Fail 

a-  [XX]  [  1  Each  procedure  step's  "pass"  box,  in  the  'Observed  Results' 

column,  was  marked,  indicating  the  'Expected  Response'  was 
observed.  (See  Appendix  C  for  the  test  procedure  performed 
for  test  OP-04 . ) 

b.  [XX]  [  ]  The  initialization  mode  datapoint  must  indicate  a 

Maintenance  Warm  Start  occurred  CR1 . 


[XX]  [  ]  The  METAR  special  generation  datapoint  must  indicate  that 

two  METAR  specials  were  generated  CR2 . 


[XX]  [  ]  Any  METAR  messages  arriving  at  the  WMSCR  simulator  after  the 

shutdown  must  not  indicate  that  a  thunder  storm  has  begun 
CR3  (before)  and  CR4  (after) . 


The  following  data,  marked  with  evaluation  criteria  cross-reference  numbers, 
is  a  subset  of  the  OT&E  formal  test  run  data.  Other  relavent  data  has  been 
included  into  OP-04 's  Test  Conduct  Form  (TCF)  file,  "OP-04. TCF". 


INPUT  MESSAGE  #:  158 

RECEIVE  TIME  (ADAS):  09/01/97  21:37:31 


21378 

21380 

RMS  ID: 

DATE: 

0x01 

09/01/97 

LOGICAL  UNIT  ID: 
TIME: 

0x20 

21:37:33 

21392 

DATAPOINT  ID: 

0x03 

CONDITION  STATUS: 

0x40 

21394 

PARAMETER  VALUE 

:  (002)  Decimal 

INPUT 

MESSAGE  #: 

159 

RECEIVE  TIME  (ADAS ) : 

09/01/97  21:37:31 

1  J  jiii  ii  II  ii  i  i  i  i 

22163 

. .  i  '  '  i  i  i  i  i  i — r 

RMS  ID: 

+++TT-r+-r+++  +  T  +  + + 

0x01 

LOGICAL  UNIT  ID: 

0x26 

22165 

DATE: 

09/01/97 

TIME: 

21:37:33 

22182 

DATAPOINT  ID: 

0x04 

CONDITION  STATUS: 

0x40 

22184  PARAMETER' VALUE:' . (  000000002' )~~DecimaI 


21  1  SPECI  K001  012132Z  AUTO  04005G15KT  7SM  R01/3000FT  TS  22/06  A2998  RMK 

22  1  A0 2  TSB32  SLP000 


|CR3 


C-366 


47  2  SPECI  K001  012137Z  AUTO  04005G15KT  2SM  R01/3000FT  OVCIOO  22/06  A2998 

48  2  RMK  A02SLP000  . .  . . . . . . . . . . . . l.?M 


C.7.4.2.  TCF  Test  Procedure  Steps 

The  following  test  procedure  steps,  referenced  by  evaluation  criteria-  "a"  of  this  test’s  'Data  Reduction  and  Analysis  Method 
paragraph  in  the  main  body  of  this  report,  were  extracted  from  test  procedure  file  "OP-04. TCF". 
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Output  the  IML:  MPS  DATA  RESPONSE  to  file.  The  output  file  is  in  directory  '/tmp1.  [X]  Pass  [  ]  Fail  Stop  Test 

@ISC:  "[F7]  [F8]  [F7]  OP-04  <2:[RTN]>  [SP]  The  Select  Log  Type  screen  is  displayed. 


TEST  #  OP-04  TESTED  BY:  _  Jock  K.  Stratton  _  DOTE:  01/SEP/97  TIME:  21:28  TEST  DIRECTOR'S  INITIALS 
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C.7.5.  TEST  OP-05  -  Restart  (Auto  Warm  Start  -  Weather) 

The  following  paragraphs  provide  information  about  data  associated  with  this 
test  but  not  included  within  the  main  body  of  this  report. 


C.7.5.1.  Associated  Evaluation  Criteria  and  Data 


The  following  Evaluation  Criteria  were  used  to  determine  the  requirements 
passed/ failed .  The  Cross  Reference  (CR)  numbers  can  be  used  to  trace  into  the 
data  found/referenced  below. 


Pass 

Fail 

a . 

(XX] 

[ 

] 

Each  procedure  step's  "pass"  box,  in  the  ’Observed  Results' 
column,  was  marked,  indicating  the  'Expected  Response'  was 

observed.  (See  Appendix  C  for  the  test 

for  test  OP-05 . ) 

procedure  performed 

b. 

[XX] 

[ 

] 

The  initialization  mode  datapoint  must 
Warm  Start  occurred  CR1. 

indicate  a  Weather 

c. 

[XX] 

[ 

] 

The  METAR  special  generation  datapoint 
two  METAR  special  were  generated  CR2 . 

must  indicate  that 

d. 

[XX] 

[ 

] 

METAR  messages  arriving  at  the  WMSCR 

simulator  after  the 

shutdown  must  indicate  that  a  thunder  storm  has  begun  CR3. 


The  following  data,  marked  with  evaluation  criteria  cross-reference  numbers, 
is  a  subset  of  the  OT&E  formal  test  run  data.  Other  relavent  data  has  been 
included  into  OP-05' s  Test  Conduct  Form  (TCF)  file,  "OP-05 . TCF" . 


INPUT  MESSAGE  #:  158 

RECEIVE  TIME  (ADAS):  09/01/97  21 : 58 : 29 


21378 

21380 

RMS  ID: 

DATE: 

++++++++++++++++ 

0x01 

09/01/97 

LOGICAL  UNIT  ID: 
TIME: 

0x20 

21:58:31 

21392 

DATAPOINT  ID: 

0x03 

CONDITION  STATUS: 

0x40 

21394 

PARAMETER  VALUE 

:  (001)  Decimal 

INPUT 

MESSAGE  #: 

159 

RECEIVE  TIME  (ADAS)  : 

09/01/97  21:58:30 

22163 

RMS  ID: 

0x01 

•*'  LOGICAL  UNIT  ID: 

0x26 

22165 

DATE: 

09/01/97 

TIME: 

21:58:32 

22182 

DATAPOINT  ID: 

0x04 

CONDITION  STATUS: 

0x40 

22184  PARAMET  ER"  VALUE . 0000000  01 J' 'Decimal 


21  1  SPECI  K001  012154Z  AUTO  04005G15KT  7SM  R01/3000FT  TS  22/06  A2998  RMK 

22  1  A0 2  TSB54  SLP000 


CR1 


CR2 


|CR3 
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47  2  SPECI  K001  012158Z  AUTO  04005G15KT  2SM  R01/3000FT  OVCIOO  22/06  A2998 

48  2  RMK  AO 2  TSB54  SLP000  . . . . . . . 


C.7.5.2.  TCF  Test  Procedure  Steps 

The  following  test  procedure  steps,  referenced  by  evaluation  criteria  "a"  of  this  test's  'Data  Reduction  and  Analysis  Method' 
paragraph  in  the  main  body  of  this  report,  were  extracted  from  test  procedure  file  "OP-05. TCF". 
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Output  the  IML:  MRS  DATA  RESPONSE  to  file.  The  output  file  is  in  directory  '/tmp'.  [X]  Pass  [  ]  Fail  Stop  Test 

@ISC:  "[F7]  [F8]  [F7]  OP-05  <2:[RTN]>  [SP] 

[RTN]  S  [UP]  <2:[RTN]>  [wait]  [F14]n  The  Select  Log  Type  screen  is  displayed. 


C.7.6.  TEST  OP-06  -  Restart  (Manual  -  Overall  Warm) 

The  following  paragraphs  provide  information  about  data  associated  with  this 
test  but  not  included  within  the  main  body  of  this  report. 


C.7.6.1.  Associated  Evaluation  Criteria  and  Data 

The  following  Evaluation  Criteria  were  used  to  determine  the  requirements 
passed/ failed.  The  Cross  Reference  (CR)  numbers  can  be  used  to  trace  into  the 
data  found/referenced  below. 

Pass  Fail 


a . 


b. 


c . 


d. 


[XX]  [  ]  Each  procedure  step's  "pass"  box,  in  the  'Observed  Results' 

column,  was  marked,  indicating  the  'Expected  Response'  was 
observed.  (See  Appendix  C  for  the  test  procedure  performed 
for  test  OP-06. ) 


[XX] 


The  initialization  mode  datapoint  must  indicate  a  Overall 
Warm  Start  occurred  CR1. 


[XX]  [  ]  The  METAR  special  generation  datapoint  must  indicate  the 
total  number  of  METAR  specials  generated  CR2  (=  #  of  CR3  +  # 
of  CR4)  .  .  . . . 

[XX]  [  ]  METAR  messages  arriving  at  the  WMSCR  simulator  before  CR3 

and  after  CR4  the  shutdown  must  indicate  that  a  thunder 
storm  begin. 


The  following  data,  marked  with  evaluation  criteria  cross-reference  numbers, 
is  a  subset  of  the  OT&E  formal  test  run  data.  Other  relavent  data  has  been 
included  into  OP-06's  Test  Conduct  Form  (TCF)  file,  "OP-06. TCF". 


INPUT  MESSAGE  #:  315 

RECEIVE  TIME  (ADAS):  09/01/97  22:26:30 


42743  RMS  ID:  0x01 

42745  DATE:  09/01/97 

42757 . DATAPOINT"  IDi . 0x03"""  . . 

42759  PARAMETER  VALUE:  (000)  Decimal 


LOGICAL  UNIT  ID: 

TIME: . 

CONDITION" STATUS : 


0x20 

22:26:33 
. 0x40 . 


CR1 


INPUT 

MESSAGE  #: 

316 

RECEIVE  TIME  (ADAS): 

09/01/97  22:26:31 

43528 

RMS  ID: 

M~r-M"M~|-T++++++++ 

0x01 

LOGICAL  UNIT  ID: 

43530 

DATE: 

09/01/97 

TIME: 

43547 

DATAPOINT  ID: 

0x04 

CONDITION  STATUS: 

43549  . PARAMETER  VALUE:" .  (000000 002  )  Decimal 


0x26 

22:26:34 
0x40 . 


21  1  SPECI  K001  012220Z  AUTO  04005G15KT  7SM  R01/3000FT  TS  22/06  A2998  RMK 

22  1  A0 2  TSB20  SLP000 


iCR2 


i£R3 
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48  2  RMK  AO 2  TSB20  SLP000  _ _ _ _ _ 


C-375 


C.7.6.2.  TCF  Test  Procedure  Steps 

The  following  test  procedure  steps,  referenced  by  evaluation  criteria  "a"  of  this  test's  'Data  Reduction  and  Analysis  Method 
paragraph  in  the  main  body  of  this  report,  were  extracted  from  test  procedure  file  "OP-06. TCF". 
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C.7.7.  TEST  OP-07  -  Restart  (Manual  -  Cold  Start) 

The  following  paragraphs  provide  information  about  data  associated  with  this 
test  but  not  included  within  the  main  body  of  this  report. 


C.7.7.1.  Associated  Evaluation  Criteria  and  Data 

The  following  Evaluation  Criteria  were  used  to  determine  the  requirements 
passed/failed.  The  Cross  Reference  (CR)  numbers  can  be  used  to  trace  into  the 
data  found/referenced  below. 


Pass  Fail 

[XX]  [  ]  Each  procedure  step's  "pass"  box,  in  the  ’Observed  Results' 

column,  was  marked,  indicating  the  'Expected  Response'  was 
observed.  (See  Appendix  C  for  the  test  procedure  performed 
for  test  OP-07 . ) 

[XX]  [  ]  The  initialization  mode  datapoint  must  indicate  a  Cold  Start 

occurred  CR1 . 

f  J  The  METAR  special  generation  datapoint  must  indicate  the 
number  of  METAR  special  messages  generated  after  the 
re-start  CR2  (equals  the  total  number  of  CR4 ' s ) . 

[XX]  [  ]  WMSCR  Metar  message  received  before  the  shutdown  must 

indicate  a  thunderstorm  begin  CR3 . 


[XX]  [  ]  WMSCR  METAR  messages  arriving  after  the  shutdown  must  not 

indicate  that  a  thunder  storm  has  begun  CR4 . 


The  following  data,  marked  with  evaluation  criteria  cross-reference  numbers, 
is  a  subset  of  the  OT&E  formal  test  run  data.  Other  relavent  data  has  been 
included  into  OP-07 's  Test  Conduct  Form  (TCF)  file,  "OP-07. TCF". 


INPUT  MESSAGE  #: 

RECEIVE  TIME  (ADAS  )  : 

315 

09/01/97  22:42:31 

LOGICAL  UNIT  ID: 
TIME : 

0x20 

22:42:33 

42743 

42745 

RMS  ID: 

DATE: 

+++T++++++++++++ 

0x01 

09/01/97 

42757 

DATAPOINT  ID: 

0x03 

CONDITION  STATUS: 

0x40 

42759 

PARAMETER  VALUE 

:  (003)  Decimal 

INPUT 

MESSAGE  # : 

316 

RECEIVE  TIME  (ADAS) : 

09/01/97  22:42:31 

43528 

RMS  ID: 

0x01 

LOGICAL  UNIT  ID: 

0x26 

43530 

DATE: 

09/01/97 

TIME: 

22:42: 34 

43547 

DATAPOINT  ID: 

0x04 

CONDITION  STATUS: 

0x40 

CR1 


C-378 


43549  PARAMETER  VALUE:  (000000001)  Decimal . ’ . iCR2 

21  1  SPECI  K001  012237Z  AUTO  04005G15KT  7SM  R01/3000FT  TS  22/06  A2998  RMK 

22  1  AO 2  TSB37  SLP000  _ _  lCR3 

47  2  SPECI  K001  012242Z  AUTO  04005G15KT  2SM  R01/3000FT  OVCIOO  22/06  A2998 

48  2  RMK  AO 2  SLP000  _  _ _ _ ’ _ l.cM 
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then  acknowledge  the  IPS  Event.  start  has 

@ASC:  "si  [RTN]  testl2  [RTN]  [F7]  [F9]  [SP] 

[SP]  [SP]  [RTN]  [SP]  [RTN]" 

@ISC:  " [F7] " 


TEST  #  OP-07  TESTED  BY:  _ _  Jock  K.  Stratton  _  DATE:  01/SEP/97  TIME:  22:33  TEST  DIRECTOR’S  INITIALS 


0381 


C.7.8.  TEST  OP-08  -  Restart  (Manual  Warm  Start  -  Maint) 

The  following,  paragraphs  provide  information  about  data  associated  with  this 
test  but  not  included  within  the  main  body  of  this  report. 


C.7.8. 1.  Associated  Evaluation  Criteria  and  Data 

The  following  Evaluation  Criteria  were  used  to  determine  the  requirements 
passed/ failed.  The  Cross  Reference  (CR)  numbers  can  be  used  to  trace  into  the 
data  found/referenced  below. 


Pass  Fail 

]  Each  procedure  step's  "pass"  box,  in  the  'Observed  Results' 
column,  was  marked,  indicating  the  'Expected  Response'  was 
observed.  (See  Appendix  C  for  the  test  procedure  performed 
for  test  OP-08.) 

]  The  initialization  mode  Data  Point  must  indicate  a 
Maintenance  Warm  Start  occurred  CR1 . 

]  The  METAR  special  generation  Data  Point  must  indicate  that 
three  METAR  specials  were  generated  CR2 . 


]  METAR  messages  arriving  at  the  WMSCR  simulator  after  the 
shutdown  must  not  indicate  that  a  thunder  storm  has  begun 
CR3 . 


a.  [XX]  [ 

b.  [XX]  [ 

c.  [XX]  [ 

d.  [XX]  [ 


The  following  data,  marked  with  evaluation  criteria  cross-reference  numbers, 
is  a  subset  of  the  OT&E  formal  test  run  data.  Other  relavent  data  has  been 
included  into  OP-08 's  Test  Conduct  Form  (TCF)  file,  "OP-08. TCF". 


INPUT  MESSAGE  #:  315 

RECEIVE  TIME  (ADAS):  09/01/97  22:55:31 


42743  RMS  ID:  0x01 

42745 DATE:  09/01/97 

42757 . DATAPOINT'' ID: . 0x03 . 

42759  PARAMETER  VALUE:  (002)  Decimal 


LOGICAL  UNIT  ID:  0x20 

TIME": . " . 22:55:32 

CONDITIONSTATUS: . 0x4  0 


INPUT  MESSAGE  #: 

RECEIVE  TIME  (ADAS) 


316 

09/01/97  22:55:31 


43528 

43530 


RMS  ID: 
DATE: 


0x01  LOGICAL  UNIT  ID: 

09/01/97  TIME:" . 

0x04 


43547 

43549 


DATAPOINT  ID: 


PARAMETER  VALUE: 


CONDITION  STATUS; 


(000000002 )  Decimal 


0x26 

22:55:3  3 
. 6x40 . 


21  1  SPECI  K001  012250Z  AUTO  04005G15KT  7SM  R01/3000FT  TS  22/06  A2998  RMK 

22  1  A02  TSB50  SLP000 


CR1 


CR2 


|CR3 


C-382 


47  2  SPECI  K001  012255Z  AUTO  04005G15KT  2SM  R01/3000FT  OVCIOO  22/06  A2998 

48  2  RMK  AO 2  SLP000  _ 


C.7.8.2.  TCF  Test  Procedure  Steps 

The  following  test  procedure  steps,  ref 
paragraph  in  the  main  body  of  this  repo 
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C.7.9.  TEST  OP-09  -  Restart  (Manual  Warm  Start  Weather) 

The,  following  paragraphs  provide  information  about  data  associated  with  this 
test  but  not  included  within  the  main  body  of  this  report. 


C.7.9.1.  Associated  Evaluation  Criteria  and  Data 

The  following  Evaluation  Criteria  were  used  to  determine  the  requirements 
passed/failed.  The  Cross  Reference  (CR)  numbers  can  be  used  to  trace  into  the 
data  found/referenced  below. 

Pass  Fail 

a.  [XX]  [  ]  Each  procedure  step's  "pass"  box,  in  the  'Observed  Results' 

column,  was  marked,  indicating  the  'Expected  Response'  was 
observed.  (See  Appendix  C  for  the  test  procedure  performed 
for  test  OP-09 . ) 

b.  [XX]  [  ]  The  initialization  mode  Data  Point  must  indicate  a  Weather 

Warm  Start  occurred  CR1. 


c.  [XX]  [  ]  The  METAR  special  generation  Data  Point  must  indicate  that 

two  METAR  special  was  generated  CR2 . 


d.  [XX]  [  ]  METAR  messages  arriving  at  the  WMSCR  simulator  after  the 

shutdown  must  indicate  that  a  thunder  storm  has  begun  CR3 . 


The  following  data,  marked  with  evaluation  criteria  cross-reference  numbers, 
is  a  subset  of  the  OT&E  formal  test  run  data.  Other  relavent  data  has  been 
included  into  OP-09 's  Test  Conduct  Form  (TCF)  file,  "OP-09. TCF". 


INPUT  MESSAGE  #: 

RECEIVE  TIME  (ADAS) 


315 

09/01/97  23:15:30 


42743 

42745 

42757 

42759 


RMS  ID: 

DATE: 

DATAPOINT  ID: . 

PARAMETER' VALUE': 


0x01 

09/01/97 

. 0x03 . . 

(001)  Decimal 


LOGICAL  UNIT  ID: _ 0x20 

TIME:  23:15:33 

CONDITION  STATUS': . - . 0x4 6""'" 

. .  CR1 


INPUT  MESSAGE  #:  316 

RECEIVE  TIME  (ADAS):  09/01/97  23:15:30 


43528 

43530 

RMS  ID: 

DATE: 

0x01 

09/01/97 

LOGICAL  UNIT  ID:  0x26 

TIME:  23:15:33 

43547 

DATAPOINT  ID: 

0x04 

CONDITION 

STATUS:  0x40 

43549 

PARAMETER  VALUE: 

(000000001) 

Decimal 

CR2 

21  1  SPECI  K001  012309Z  AUTO  04005G15KT 

7SM  R01/3000FT  TS 

22/06  A2998  RMK 

22  1 

A0 2  TSB09  SLP000 

|CR3 

C-386 


47  2  SPECI  K001  012315Z  AUTO  04005G15KT  2SM  R01/3000FT  OVCIOO  22/06  A2998 

48  2  RMK  AO 2  TSB09  SLP000  _  _ ... _ _ _ _ _ _ _ _ _ _ _ _ _ ]CR4 
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C.7.10.  TESTS  OP-10  &  OP-11  -  ASC  Display 

The  following  paragraphs  provide  information  about  data  associated  with  these 
tests  but  not  included  within  the  main  body  of  this  report. 


C.7.10.1.  Associated  Evaluation  Criteria  and  Data 

The  following  Evaluation  Criteria  were  used  to  determine  the  requirements 
passed/ failed .  The  Cross  Reference  (CR)  numbers  can  be  used  to  trace  into  the 
data  found/referenced  below. 


The  formal  test  data  for  these  tests  are  the  Test  Conduct  Forms  (TCFs) 
completed  by  the  test  operator  during  Formal  Test  Run  execution.  The  TCF 
files  for  these  tests  are  "OP-IO.TCF"  and  "OP-11. TCF". 


C.7.10.2.  TCF  Test  Procedure  Steps 

The  test  procedure  steps  for  these  tests  are  not  included  herein  for  the 
following  reasons: 

1)  Numerous  test  procedure  step  failures  during  formal  testing, 

detailed  in  PTR  OTE-045,  due  to  improper  indexing  into  the 
Context  Sensitive  Help  file. 

2)  The  Full-scope  ASC  Display  (OP-10)  TCF  file,  "OP-10. TCF",  is 

approximately  200  pages  in  length. 

3)  The  Limited-scope  ASC  Display  (OP-11)  TCF  file,  "OP-11. TCF",  in 

nearly  60  pages  in  length. 

4)  Correction  of  PTR  OTE-045  has  been  deferred  to  the  ADAS  Y2K  build. 


C.7.11.  TEST  OP-13  -  Normal  Event  Logging 

The  following  paragraphs  provide  information  about  data  associated  with  this 
test  but  not  included  within  the  main  body  of  this  report. 


C.7.11. 1.  Associated  Evaluation  Criteria  and  Data 

The  following  Evaluation  Criteria  were  used  to  determine  the  requirements 
passed/failed.  The  Cross  Reference  (CR)  numbers  can  be  used  to  trace  into  the 
data  found/referenced  below. 

Pass  Fail 


C-390 


a . 


b. 


[XX]  [  ] 


[«]  [  ] 


Each  procedure  step's  "pass"  box,  in  the  'Observed  Results* 
column,  was  marked,  indicating  the  'Expected  Response'  was 
observed.  {See  Appendix  C  for  the  test  procedure  performed 
for  test  OP-13 . ) 

The  Events  contained  in  the  ADAS  Event  log  must  show  that 
each  entry  contains  the  event  number  as  in  CR1,  date  /time 
as  in  CR2,  priority  as  in  CR3  and  description  as  in  CR4 . 

Each  minute,  the  error  messages  returned  by  DLP  generate  an 
event  type  21,  as  in  CR5  through  CR12 .  I 

Each  event  type  21  should  indicate  a  non-critical  event 
priority,  as  in  CR3A.  I 

The  event  description  must  accurately  identify  the  event 
CR4  .•••■'  I 

The  operational  mode  datapoint  must  always  indicate  a  mode 
of  'FULL',  even  after  the  Mode  Selection  Switch  was  switched 
to  'UNATTENDED'  mode.  CR18  &  CR19  Verify  that  no  reduced  | 
operational  mode  indication  was  given  during  the  time  the 
Control  Panel  Switch  was  set  to  'UNATTENDED'.  Verify  that 
all  input  and  output  at  the  ADAS  Unix  Console  (AUC)  was 
redirected  to  the  printer  when  in  'UNATTENDED'  mode',  as  in 
CR2  0 .  t 

The  following  data  marked  with  evaluation  criteria  cross-reference  numbers  is 
a  subset  of  the  relevant  OT&E  formal  test  run  data  that  has  been  included  into 
OP-13' s  Test  Conduct  Form  (TCF)  file,  "OP-13. TCF". 

adas  :  /usr/ada_s/adastest  ->  echo  Unattended  Mode  PTR  Test 


d. 


e. 


f . 


[XX] 

[XX] 

[XX] 

[XX] 


.  02-12-98  00:27:04  .  Events: 

2  .  Responses: 

0  .  DATAPOINT  CMDS 

DISPLAY  RMS 

MASTER/OVERALL  LU 

DATAPOINTS 

ALERT 

ALARM 

DATAPOINT  NAME 

SYSTEM  STATE: 
00:20:38 

OPERATIONAL  MODE: 


ID  VALUE  CURR  PAST  CURR  PAST 

01  OPERATIONAL 
02  FULL  CR1 9 


00:20:38 

INITIALIZATION  MODE: 
00:20:38 

RMS /MAI NT  RESET: 
00:20:38 

SPECIALIST  LOGON: 
00:20:38 


03  COLD 
04  None 
05  REMOTE/ LOG  OFF 


LAST  RESET 

02-12-98 
02-12-98  { 
02-12-98 
02-12-98 
02-12-98 


ALERT  THRESHOLDS 
UPPER  LOWER  ENAB 

-1  -1  YES 


ALARM  THRESHOLDS 
UPPER  LOWER  ENAB 

-1  -1  YES 


PRESS  UP/DOWN  ARROW  KEYS  TO  POSITION  AND  TO  DISPLAY  THRESHOLDS. 
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•  SCROLL  SCROLL  PREVIOUS 

EXIT  . 

.  UP  DOWN  SCREEN 

•••  F7  .  F8  .  F9  .....  F10  .  Fll  .  F12  _ _  F13  .....  F14 

EVENT  PRIORITY:  non-critical  DATE/TIME  STAMP:  02-12-98  00:21:03 

EVENT  SEQ.  NUMBER:  68  EVENT  TYPE:  21  CSC  ID:  11.02  ~ 

An  erroneous  message  has  been  triggered  by  System  Logging . 

message  type:  ADAS  received  error  message 

error  type:  DLP  error  message  error  code:  DLP  invalid  ADU  type  rcvd 

. 4  >07  error  number:  1 

error  offset:  6 . 


EVENT  PRIORITY:  non-critical  DATE/TIME  STAMP:  02-12-98  00:22:03 
EVENT  SEQ.  NUMBER:  250  EVENT  TYPE:  21  CSC  ID:  11.02 

triggered  by  System  Logging . 

message  type:  ADAS  received  error  message 

. error  type:  DLP  error  message  error  code:  DLP  invalid  ADU  type  rcvd 

. original  esc  id:  4.07  error "nuiiiber":""2’"’.’ . . . . . 

error  offset:  53 . 


EVENT  PRIORITY:  non-critical  DATE/TIME  STAMP:  02-12-98  00:23:04 
EVENT  SEQ.  NUMBER:  258  EVENT  TYPE:  21  CSC  ID:  11.02 

An  erroneous  message  has  been  triggered  by  System  Logging . 

. ^e^sage  typej  ADAS  received  error  message 

. . error  type:  DLP  error  message  error  code:  DLP  invalid  ADU  type  rcvd 

original  esc  id:  4.07  error  number:  3  . 

error  offset :  i06 


EVENT  PRIORITY:  non-critical  DATE/TIME  STAMP:  02-12-98  00:24:03 

EVENT  SEQ.  NUMBER:  266  EVENT  TYPE:  21 _ CSC  ID:  11.02 

An  erroneous  message  has  been  triggered  by  System  Logging. 

. YP.®.;....ApA,s  received  error  message 

error  type:  DLP  error  message  error  code:  DLP  invalid  ADU  type  rcvd 
original  esc  id:  4.07  error  number:  4 
error  offset:  159 


EVENT  PRIORITY:  non-critical  DATE/TIME  STAMP:  02-12-98  00:25:03 
EVENT  SEQ.  NUMBER:  273  EVENT  TYPE:  21  CSC  ID:  11.02 

...been  triggered  by  System  Logging. 

message  type:  ADAS  received  error  message 

error  type;  DLP  error  message _ error  code:  DLP  invalid  ADU  type  rcvd 

. ,9.PiS[i5.®.i...?..s.9...id- [....4.;.07._  error  number:  5  ~  ' 

error  offset:  212 


EVENT  PRIORITY:  non-critical  DATE/TIME  STAMP:  02-12-98  00:26:03 
EVENT  SEQ.  NUMBER:  285  EVENT  TYPE:  21  CSC  ID:  11.02 

An  erroneous  message  has  been  triggered  by  System Logging” 

message  type:  ADAS _ received  error  message 

. .g-ggog-  fcyPe;  DLP  error  message  error" code :  DLP  invalid  ADU  type  rcvd 

_ gnigina  1  •  4.07  error  number:  6 
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error  offset:  265 


_L_ 


EVENT  PRIORITY:  non-critical  DATE/TIME  STAMP:  02-12-98  00:27:03 

EVENT  SEQ.  NUMBER:  292  EVENT  TYPE:  21 _ CSC  ID:  11.02 

An  erroneous  message  has :_been ... tjciggered_by  .System _Logc[ing_._ 

message  type:  ADAS  received  error  message 

error  type:  DLP  error  message  _ error  code:  DLP  invalid  ADU  type  rcvd 

original  cscTd:  4  ■  07  ~  error  number :  7 

error  of fset:  318 . 

EVENT  PRIORITY:  non-critical  DATE/TIME  STAMP:  02-12-98  00:28:03 

EVENT  SEQ.  NUMBER:  301  EVENT  TYPE:  21 .  CSC  ID:  11.02 

An  erroneous  me s  s  a  g  e  has  been  triggered  bY  SYstem  Logging. 

message  type:  ADAS  received  error  message 

error  Type;-  DLP  error  message  error  code;  DLP  invalid  ADU  type  rcvd 

"^^Tplfral'TsTTJ:""  4~707 . error'  number :  8 

error  offset:  371 _ _ 


02-12-98  00:28:51  .  Events:  4  .  Responses:  0  .  EVENT/ERROR  CMOS 

EVENT  LOG  DATA  REQUEST  FOR  PRINTER  OUTPUT 


PRIMARY  SEARCH  KEY  DATA: 

. START  DATE :  02/12 /  9  8  _ STOP  DATE: _ 02/12/98 

START  TIME :  ~  00:00:00 _ STOP  TiME:  00:28:43 

SECONDARY  SEARCH  KEY  DATA: 

. begin"event"'sequence  NUMBER :  _ 0 

END  EVENT  SEQUENCE  NUMBER: . ...0 

.  EVENT  TYPE  :  . TZTZZZ . I?. . . . 

ENTER  INTEGER  VALUE  FOR  THE  EVENT  TYPE  NUMBER. 


F8 


EXIT. 

F9  .  F10  .  Fll  .  F12  .....  F13  .  F14  . 


.  02-12-98  00:28:53  .  Events:  4  .  Responses:  0  .  EVENT/ERROR  CMDS 

. . .  RESPONSE  CONTROL  MESSAGE  STATUS  . . 

.  COMMAND  NAME:  [REPORT  EVNT/ERR  LOG] . . . . 

. RESPONSE”  STATUS  V . FAILURE""  . 

. . REMARKS': . THERE”"i”s””NO” EVENT / ERROR  LOG  DATA  MATCHING  THE  SEARCH  KEYS. 

- -  CR14  . 

.  PRESS  EXIT  KEY  TO  QUIT  WINDOW . . . 


F7 


F8 


F9 


F10 


Fll 


F12 


F13 


INPUT  MESSAGE  #: 

RECEIVE  TIME  (ADAS) : 


02/12/98  00:21:21 


13  RMS  ID:  0x01  LOGICAL  UNIT  ID:  0x20 

15  DATE:  02/12/98 . TIME: . . . 00:21:20 


EXIT. 
F14  . 
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22 

DATAPOINT  ID: 

0x02 

CONDITION 

STATUS : 

0x40 

24 

PARAMETER  VALUE: 

(000)  Decimal 

27 

DATAPOINT  ID: 

0x03 

CONDITION 

STATUS : 

6x4  0 

29 

PARAMETER  VALUE: 

(003)  Decimal 

INPUT 

MESSAGE  #:  158 

RECEIVE  TIME  (ADAS) : 

02/12/98 

00:30:08 

21378 

RMS  ID: 

r++T"T++++T 

0x01 

■TTttt 

LOGICAL  UNIT  ID: 

0x20 

21380 

DATE: 

02/12/98  TIME: 

00:30:09 

21387 

DATAPOINT  ID: 

0x02 

CONDITION 

STATUS : 

0x40 

21389 

PARAMETER  VALUE: 

(000) 

Decimal 

21392 

DATAPOINT  ID: 

0x03 

CONDITION 

STATUS : 

0x40 

21394 

PARAMETER  VALUE: 

(003) 

Decimal 

21 

1 

SPECI  K001  120021Z 

AUTO 

04  005G15KT 

7SM 

R01/3000FT 

22/06 

A2998 

RMK 

22 

1 

A02  SLP000 

47 

2 

SPECI  K001  120022Z 

AUTO 

04005G15KT 

7SM 

R01/3000FT 

22/06  A2998 

RMK 

48 

2 

AO 2  SLP000 

73 

3 

SPECI  K001  120023Z 

AUTO 

04  005G15KT 

7SM 

RO 1/300 OFT 

22/06 

A2998 

RMK 

74 

3 

A02  SLP000 

99 

4 

SPECI  K001  120024Z 

AUTO 

04005G15KT 

7SM 

R01/3000FT 

22/06 

A2998 

RMK 

100 

4 

AO 2  SLP000 

125 

5 

SPECI  K001  120025Z 

AUTO 

04  005G15KT 

7SM 

R01/3000FT 

22/06 

A2998 

RMK 

126 

5 

A02  SLP000 

151 

6 

SPECI  K001  120026Z 

AUTO 

04  005G15KT 

7SM 

RO 1/300 OFT 

22/06 

A2998 

RMK 

152 

6 

A02  SLP000 

177 

7 

SPECI  K001  120027Z 

AUTO 

04  005G15KT 

7SM 

R01/3000FT 

22/06 

A2998 

RMK 

178 

7 

AO 2  SLP000 

203 

8 

SPECI  K001  120028Z 

AUTO 

04005G15KT 

7SM 

R01/3000FT 

22/06 

A2998 

RMK 

204 

8 

A02  SLP000 

229 

9 

SPECI  K001  120029Z 

AUTO 

04  005G15KT 

7SM 

R01/3000FT 

22/06 

A299  8 

RMK 

230 

9 

AO 2  SLP000 

255  10  SPECI  K001  120030Z  AUTO  04005G15KT  7SM  R01/3000FT  22/06  A2998  RMK 

256  10  A02  SLP000  "  ~~~ - 
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screen.  The  ADAS  is  switched  to  Attended  Mode. 

0ADAS  Control  Panel:  Turn  Mode  Knob  to  "A"  The  PC  captures  the  RMS  Master  dp 

@ASC :  ” [F2] "  screen. 


TEST  #  OP-13  TESTED  BY:  _  Jock  K.  Stratton  _  DATE:  12/FEB/98  TIME:  00:17  TEST  DIRECTOR’S  INITIALS 


o 

P 

P 

P 

p 

a 

P 

p 

CO 

CO 

CO 

CO 

0 

CO 

to 

P 

0 

CD 

CD 

0 

p 

0 

0 

U 

< 

Eh 

Eh 

fr> 

Eh 

to 

Eh 

Eh 

a 

a 

a 

a 

o 

Q* 

a 

*— 1 1 

o 

o 

o 

o 

T3 

0 

o 

p 

p 

p 

p 

0 

P 

4-> 

0 

fa 

CO 

CO 

co 

CO 

fa 

CO 

CO 

10  CO  CO 
WWW 

000 

&  &4 


XXX 


c 

o 

P  to  P 
G  P  a 
a  a  6 
■P  -H  O 
GPP 

o  a  a 


c  - 

0  C 
0  -h  • 
p  tr>  to 
O  0 


(0 


o 

I— ( 

0  O 


0  a) 
x  x 
p  -p 

to  >*  o 

0  0  TJ 
P  «H  G 

g  a-n 
P  to  3 
a  'H 
0  -a 
u 

o 

O  D 
fa  rtj 


p 

G 

> 

0) 


000 

xxx 

Eh  H  Eh 


0 

fa 


10 

nJ 

a. 


to 
to  CD 
>i  p 
0  0 
rH  o 
a-p 

CO  TJ 
•H  G 
•O  -H 

M  U 

co  d 

H  < 

0  0 
X  X 

EH  Eh 


H  i— i 
CM  ^  CM 

in 

A  A  ^ 

g|A 

a;  «  ^ 

CL  ■-h  H 
..  ••  fa 
r-  r-  *-h 
V  V  •• 

v  m 
,  „  V 

r*  »-i  _j 
fclHnn 

p  ^ 

H  r-. 

3  m  h  P 

■"fife-g 

vo 

-3*1 

fa  ”. 

H  *-*  5 

v  £5.  &  &  fe 


0 

fa 


0 

fa 


0 

fa 


CO 

CO 

0 

fa 


is 

* 

• 

a  ^ 

a 

G 

£  £ 

£  • 

0  • 

p  0 

P  T3 

0  2 

\  0 

\  0 

P  £5 

-  p 

-  >i 

U  O 

u 

0 

(0  Q 

>1  to 

k-H  i— 1 

p 

P  D, 

P  CO 

o 

O  to 

•H  *H 

p  _ 

P  -H 

G 

o  £ 

O  TJ 

0  CO 

0 

«p  < 

p 

P  CO 

0  D 

-H 

•rH  -H 

TJ  < 

T3 

•o 

CO  0 

C  ® 

.5  d> 

H  0 

..  CO 

G 
G  0 

-  X 

•H  0 

p  p 

P 

O 

P 

O 

o 

X 

co 

fa 


d) 

X 

p 


•  • 

.. 

.. 

.. 

G 

G  •• 

H 

o 

o 

G 

hH 

CJ 

a  o 

a  u 

CO 

CO 

CO 

0 

CO 

D 

P  CO 

P  CO 

M 

C 

M 

X 

M 

< 

G  M 

G  H 

<H) 

CE> 

s 

CE> 

<SJ 

O  <2J 

O  C2J 

m 

in 

rH 

t — I 

rH 

*IH 

0 

fa 


to 

0 


0 

X 

p 

•a 

c 

0 

G 

3 


d5 

fa 


0 

fa 


T*  0 

0  ^ 

•H  CO 

0  P 

U 

0 

P 

fa 

rH 

rH  rH 

•  *rH 

ill 

CO 

:  • 

•H 

•H  G 

TJ 

0 

«W  jj 

4H  0 

0 

G  M 

to 

f; 

3 

.  4H 

P 

X  0* 

0 

.  «?*:•’ 

P  Q,  • 

G  T3 

P  0 

G  *d 

0 

CO  ^ 

r— t 

u 

ft  3  0 

P  O  >1 

G  0 

O  rH 

a 

P  M 

G  CO 

O  M 

r-H 

X 

0 

u 

ISI 

ogin 

i 

a 

0  0  to 

0  0 

0 

rH 

0  - 

o 

o 

X  X  -H 

X  X 

X 

X 

p 

Eh  Eh  T3 

.  EH  Eh 

H 

Eh  0 

fa 

0396 


C.7.12.  TEST  OP-14  -  Extraordinary  Event  Log 

The  following  paragraphs  provide  information  about  data  associated  with  this 
test  but  not  included  within  the  main  body  of  this  report. 


C.7.12.1.  Associated  Evaluation  Criteria  and  Data 

The  following  Evaluation  Criteria  were  used  to  determine  the  requirements 
passed/failed.  The  Cross  Reference  ( CR)  numbers  can  be  used  to  trace  into  the 
data  found/referenced  below. 

Pass  Fail 

a.  [XX]  [  ]  Each  procedure  step's  "pass"  box,  in  the  'Observed  Results' 

column,  was  marked,  indicating  the  'Expected  Response’  was 
observed.  (See  Appendix  C  for  the  test  procedure  performed 
for  test  OP-14 . ) 

b.  [XX]  [  ]  The  ADAS  Event  log  must  show  the  events  for  the  CTS  time 

shift,  event  type  9,  as  in  CR1,  CR2,  &  CR3 .  I 

c.  [XX]  [  ]  The  ADAS  Event  log  must  show  the  events  for  the  AWOS  error 

responses,  event  type  21,  as  in  CR8  &  CR9.  I 

d.  [XX]  [  ]  The  ADAS  Event  log  must  show  the  events  for  the  WMSCR 

communications  status  changes,  event  type  12,  as  in  CR4,  I 
CR5,  CR6,  &  CR7 .  I 


e.  [XX]  [  ]  Each  event  must  indicate  its'  priority. 

f.  [XX]  [  ]  Event  descriptions  must  accurately  describe  the  event. 


The  following  data,  marked  with  evaluation  criteria  cross-reference  numbers, 
is  a  subset  of  the  OT&E  formal  test  run  data.  Other  relavent  data  has  been 
included  into  OP-14 's  Test  Conduct  Form  (TCF)  file,  "OP-14 . TCF" . 


EVENT  PRIORITY:  non-critical  DATE/TIME  STAMP:  01-05-98 
EVENT  SEQ.  NUMBER:  243  EVENT  TYPE:  9 . CSC  ID:  2.01 


ADAS  time  has  been  reset  b] 


current  time:  01-05-98 19:27:16 
new  time:  01-05-98  19:27:18 


19:27:18 


CR1 


EVENT  PRIORITY:  non-critical  DATE/TIME  STAMP:  01-05-98  20:06:11 

EVENT  SEQ.  NUMBER:  260  EVENT  TYPE :  9 . CSC  ID:  2.0l 

ADAS  time  has  been  reset  by  CTM. 

cu r r e nt  time  :_0_1 -  05-98  _  19_:  2_8_:_1_3 

new  time:  01-05-98  20:06:11  . . . 


EVENT  PRIORITY:  non-critical  DATE/TIME  STAMP:  01-05-98  20:15:13 


C-397 


EVENT  SEQ.  NUMBER:  298  EVENT  TYPE:  9  CSC  ID:  2.01 

ADAS  time  has  been  reset  byCTM. . ■ . 

current  time:  01-05-98  20:09:12 

new  time:  01-05-98  20:15: 13 


EVENT  PRIORITY:  non-critical  DATE/TIME  STAMP:  01-05-98  19:25:14 

EVENT  SEQ.  NUMBER:  39  EVENT  TYPE:  12 _  CSC  ID:  5.01 

connection  has  changed. 


comm  status: 


enabled- failed 


CR4 


EVENT  PRIORITY:  non-critical  DATE/TIME  STAMP:  01-05-98  19:25:26 
EVENT  SEQ.  NUMBER:  45  EVENT  TYPE:  12  CSC  ID:  5.01 

Status  of  the  WMSCR  connection  has  changed. 

comm  status:  enabled-active 


EVENT  PRIORITY:  non-critical  DATE/TIME  STAMP:  01-05-98  20:09:07 
EVENT  SEQ.  NUMBER:  287  EVENT  TYPE:  12  CSC  ID:  5.01 

CR  connection  has  changed. 

comm  status:  enabled-failed 


EVENT  PRIORITY:  non-critical  DATE/TIME  STAMP:  01-05-98  20:15:38 
EVENT  SEQ.  NUMBER:  299  EVENT  TYPE:  12  CSC  ID:  5.01 

Status  of  the  WMSCR  connection  has  changed. 


comm  status: 


enabled-active 


CR7 


EVENT  PRIORITY:  non-critical  DATE/TIME  STAMP:  01-05-98  20:07:04 
EVENT  SEQ.  NUMBER:  262  EVENT  TYPE:  21  __  CSC  ID:  11.02 
^■■■■9.9£999.9.99..-.^9.ssage  has  been  triggered  "by  System"  Loggirig" 

interface  id:  K002  message  type:  ADAS  received  erroneous  message 
error  type:  AWOS  test  message  error  code:  ADU  header  error 

. error  number:  1 

error  offset:  6 


EVENT  PRIORITY:  non-critical  DATE/TIME  STAMP:  01-05-98  20:08:07 
EVENT  SEQ.  NUMBER:  278  EVENT  TYPE:  21  CSC  ID:  11.02 

An  erroneous  message  has i  been ...triggered  by  System"  Logging.'''' 

interface  id:  K002  message  type:  ADAS  received  erroneous  message 

. ®£?.9.?....type s  _  AWOS i  test  message  error  code:  ADU  header  error 

. original  esc  id:"  "3".  02 . error  'n'umber  :''  2 . T . " . . . 

error  offset:  100 . 
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C.7.13.  TEST  OP-15  -  ASC  Alarm  Control 

The  following  paragraphs  provide  information  about  data  associated  with  this 
test  but  not  included  within  the  main  body  of  this  report. 


C.7.13.1.  Associated  Evaluation  Criteria  and  Data 

The  following  Evaluation  Criteria  were  used  to  determine  the  requirements 
passed/failed.  The  Cross  Reference  (CR)  numbers  can  be  used  to  trace  into  the 
data  found/ referenced  below. 

Pass  Fail 

a.  [XX]  [  ]  Each  procedure  step's  "pass"  box,  in  the  'Observed  Results' 

column,  was  marked,  indicating  the  'Expected  Response'  was 
observed.  (See  Appendix  C  for  the  test  procedure  performed 
for  test  OP-15 . ) 

b.  [XX]  [  ]  Successful  completion  of  the  manual  procedures  for  this  test 

case  indicates  the  datapoints  that  had  their  thresholds 
altered  and  the  Alarm/Alert  disabled  did  not  report  an  alarm 
to  the  ASC. 

c.  [XX]  [  ]  Successful  completion  of  the  manual  procedures  for  this  test 

case  indicates  datapoints  that  were  altered  and  the 

Alarm/Alert  re-enabled  did  report  an  Alarm/Alert  to  the  ASC. 

d.  [XX]  [  ]  When  reset,  the  counter  style  datapoints  that  were  in  Alarm 

or  Alert  must  indicate  being  reset  in  the  next  update  to  the 
MPS  simulator  after  the  operator  logs  out  of  the  ADAS  SI. 
Use  the  Reset  All  timestamp  CR1 .  DLP  LU  29  DP  04  CR2  <  CR4,  j 
AWOS  LU41  DP  0A  CR3  <  CR5 .  I 

e.  [XX]  [  ]  After  the  AM  Resources  datapoint  was  enabled  CR6,  an  EVENT 

TYPE  18  must  be  sent  to  the  SI  CR7,  and  the  RMS 

Master/os_stat  datapoint  (LU  20  DP  08) . must  indicate  an 

alarm  (value=02)  CR8 ,  I 

f.  [XX]  [  ]  Successful  completion  of  the  manual  procedures  for  this  test 

case  indicates  the  reset  initialized  the  date/time  register. 


The  following  data,  marked  with  evaluation  criteria  cross-reference  numbers, 
is  a  subset  of  the  OT&E  formal  test  run  data.  Other  relavent  data  has  been 
included  into  OP-15 's  Test  Conduct  Form  (TCF)  file,  "OP-15. TCF". 


09-04-97  21:26:04  .  Events:  1  .  Responses:  0  .  DATAPOINT  CMDS 

.  RESPONSE  CONTROL  MESSAGE  STATUS  . . 


" COMMAND "NAME: .  [ENABLE/ PI  SABLE  DATAPTS] 


C-401 


ELEMENT  UPDATED:  OPERATING  SYSTEM  LU  DATAPOINTS 

RESPONSE  STATUS: . SUCCESS . . . """ . . . 

REMARKS":' . RESPONSE^SUCCESSFUI! . R^UEStTrOPERLY' PROCESSED" . CR6 


09-04-97  21:27:36  .  Events:  7  .  Responses:  0  . 


■EVENT  PRIORITY:  non-critical 


DISPLAY  NEXT  EVENT 


ESCAPE  CMDS 


MESSAGE 


DATE/TIME  STAMP :  09-04 -97  21:27:06 


.EVENT . SEQ.  NUMBER:  513 . EVENT  TYPE:  18  CSC  ID:  10.01 

^2 — glarra/alert  condition  has  been  triggered  by  maintenance  datapoints. 


_ unit :  Operating _ System _  dp  item:  access  monitor  resources 


status :  Alarmed 


Initiated  by:  ADAS  Maintenance  Phase 


value:  2983 


..alarm .  thresh-lower :  2999 


alert 


thresh-lower : 


09  04  97  21:29:59  .  Events:  0  .  Responses:  0  .  DATAPOINT  CMDS 


RESPONSE  CONTROL  MESSAGE  STATUS 


..COMMAND  NAME:  [RESET  DATAPTS] 


. ELEMENT . UPDATED: .  ALL _ LOGICAL . UNIT  (LU)  _  DATAPOINTS 


RESPONSE  STATUS:  SUCCESS 


REMARKS:  RESPONSE  SUCCESSFUL!  REQUEST  PROPERLY  PROCESSED.  CR1 


INPUT  MESSAGE  #:  629 

RECEIVE  TIME  (ADAS):  09/04/97  21:29:06 

85473  RMS  ID:  0x01 

85475  DATE: _  09/04/97 

85507  DATAPOINT  ID:  6x08 

85509  PARAMETER  VALUE:  (002)  Decimal 


LOGICAL  UNIT  ID: 

TIME:" . 

CONDITION  STATUS: 


0x20 

21:29:08 

0x42 


INPUT  MESSAGE  #:  637 

RECEIVE  TIME  (ADAS):  09/04/97  21:29:07 


86663  RMS  ID: 


LOGICAL  UNIT  ID: 


C-402 


86665 

DATE: 

09/04/97 

TIME: 

21:29:08 

86682 

DATAPOINT  ID: 

0x04 

CONDITION 

STATUS : 

0x43 

86684 

PARAMETER  VALUE: 

(000000017) 

Decimal 

CR4 

INPUT  MESSAGE  #:  649 

RECEIVE  TIME  (ADAS):  09/04/9721:29: 

09 

88343 

RMS  ID: 

0x01 

LOGICAL  UNIT  ID: 

0x41 

88345 

DATE: 

09/04/97 

TIME: 

21:29:08 

88392 

DATAPOINT  ID: 

0x0a 

CONDITION 

STATUS : 

6x43 

CR5 

88394 

PARAMETER  VALUE: 

(000000017) 

Decimal 

INPUT  MESSAGE  #:  794 

RECEIVE  TIME  (ADAS):  09/04/97  21:33: 

08 

108028 

RMS  ID: 

0x01 

LOGICAL  UNIT  ID: 

0x29  ; 

1 

108030 

DATE: 

09/04/97 

TIME: 

21:33:08 

} 

108047 

DATAPOINT  ID: 

0x04 

CONDITION 

STATUS : 

0x43  j 

■ 

108049 

PARAMETER  VALUE: 

(000000002)  Decimal 

fCR2 

INPUT  MESSAGE  #:  806 

RECEIVE  TIME  (ADAS):  09/04/97  21:33: 

10 

109708 

RMS  ID: 

0x01 

LOGICAL  UNIT  ID: 

0x41  \ 

109710 

DATE: 

09/04/97 

TIME: 

21:33:08 

109757 

DATAPOINT  ID: 

0x0a 

CONDITION 

STATUS : 

0x43 

CR3- 

109759 

PARAMETER  VALUE: 

(000000004)  Decimal 

1 

C-403 


C.7.13.2.  TCF  Test  Procedure  Steps 


m. 

P 

C 

U 

0 

1 

o 

p 

P 

a 

p 

P 

p 

p 

p 

P 

■H 

CO 

03 

03 

to 

to 

to 

co 

to 

(0 

p 

1 

P 

<u 

CM  03 

p 

0) 

0) 

03 

03 

03 

03 

-p 

o 

H 

CO 

E-4 

E-« 

Eh 

Eh 

Eh 

0 

co 

rt! 

P  P 

•5-1 

p 

a 

U  03 

o 

a 

a 

a 

a 

a 

a 

< 

rH 

o 

03  U 

TJ 

o 

o 

o 

o 

O 

o 

M 

-rH 

p 

G 

03 

p 

p 

p 

p 

P 

4-5 

CO 

P 

03 

CO 

C 

PS 

CO 

CO 

CO 

CO 

CO 

CO 

•H 

M 

32 

Cm 

O 

O 

M 

>i 

i — 1 

CO 

f0 

“ 

<D 

rH 

M 

rH 

rH 

rH 

M 

rH 

rH 

rH 

Cm 

CO 

•rH 

-rH 

-rH 

•rH 

•H 

•H 

•H 

•H 

•H 

5 

o 

G 

03 

03 

03 

03 

03 

03 

03 

G 

03 

p 

o 

O 

Cm 

Cm 

Cm 

Cm 

a 

a 

Cm 

Cm 

Cm 

TJ 

w 

cc 

a 

to 

— 

r-, 

— 

r-. 

r-1 

r-i 

r—i 

r—i 

r-. 

C 

M 

<u 

i_j 

i _ , 

.  ■ 

1—4 

.  . 

.  . 

.  . 

.  . 

. 

aj 

Q 

os 

C 

E-« 

T3 

<y 

CO 

to 

to 

to 

to 

to 

CO 

CO 

CO 

CO 

j> 

to 

CO 

to 

to 

to 

to 

CO 

CO 

CO 

O 

E3 

3-4 

03 

G 

03 

03 

03 

G 

G 

id 

03 

E-< 

(D 

CM 

CM 

04 

CM 

04 

CM 

04 

04 

04 

-P 

CO 

U 

D 

P 

o 

tx] 

[X] 

5 

X 

X 

X 

X 

X 

5 

TJ 
0 
CC 

(0  r ' 

£  y 


XJ  4_] 


n3 

•H 

M 

Q) 

-P 

P 

O 

C 

o 

•H 

-P 

03 

P 

r~ H 

03 

> 

0 

£>n 

X) 

T3 

0 

O 

C 

0 

P 

0) 

4-1 

0 

P 


W  W 

0-)  *H 


T3 

O 

X> 


0 
P 
P 
TJ 
0 
U 
O 
P  C 
Qj  *H 
03 

•P  B 
co 

0  0 

-p  x: 

•p 

a  c 

5 


O 
• — ! 
i — I 

O 

4-1 

0 

rC 


x: 

a 

03 

P 

tn 

03 

P 

03 

a 


w 

2 


0 

P 

P 

TJ 

0 

o 

o 

p 

a 


-p 

p 

o 

a 

0 

p 


04 

w 

CO 


w 

s-* 

< 

Q 


C 

O 

P 

P 

aj 

u 

p 


4* 

o 

o 

p 


m 

Q 

w 

Eh 

CO 

W 

Eh 


CU 

o 


w 


cn 

P 

u 

<13 

c 

5  • 
o  to 
U  p 
u 

a 


x  S 

u  g 

*  z 

03  CO 

P  CM 

E -»  M 


03  CO 
M  CM 
P  H 
oj 

0  0) 
p 

.e* 

o 

P  o 

03  P 

a 


oj  o 

a 


>.g 

<4-4  < 

-rH  ^ 

M 

§  CO 

r  *C 

Q 

..  ** 

|5  tj 
lwa 

CO  H 
P  M 

P  O 
U  (U  s 

PGM 

Id  CD 
CM  O  < 
0  U  ^ 


P 

n 

o 

a 

04 

w 

CO 

<D 

P 

P 


P 

u 

03 

G 

G 

O 

u 


p 

id 

u 


p 

id 

U 


G 

a) 

a 

o 


Cn 

O 


0) 

P 

P 


to 

p 

M 

id 

p 

to 


& 

o 

r— I 

G 

<d 

o 

p 

to 

•H 


U 

0) 

a 

CO 


to 

>1 

<d 


>i 

05 


Id  a)  -  0) 

P  P  G  P 
03  Id  03  P 
dd  p 

4-4 

w  0  03  O 

**  S  03  p 
p  n 
v  0) 

»  n  £  .5 
S  ^  O' 

M  03  n 


03 

6 

P 

P 

D 

Cm 

co 

CO 

w 

u 

CJ 

D 


>  TJ  P  0 


P  i) 

s» 

03  .!] 


U  P 
O 

P  _ 

“§ 


a>  c 
-  p  o 
p  P  p 

<1  jj 

■  25 
S  H 


p 

p 

g 

CO 

CO 

1  ■  g 

u  c 

P  rH 

u 

G 

g 

•rH 

•rH 

M 

■  .  -H 

03  03 

p 

O 

o 

a 

Q 

CO 

•  4 

CO 

O  -rH 

fd 

a 

o 

o 

CO  0) 

•H  P 

a 

o 

o 

CJ 

CO 

D 

<C  M 

TJ  -H 

o 

3H 

p 

D 

CM 

M 

a  -h 

G  G 

< 

CM 

CM 

M 

< 

M 

C2J 

<  P  HJ 

•H  M 

a  ^ 

Cm 

co 

(d  04 
03 

|S 

>>  p 

u 

o 

>1  a 

p 

•rH  CM 
3-1  W 
03  CO 
> 

CO 

< 

i-H  < 


CM  •*-' 
CO 
P 
P  O 
u  a) 
p  G 
fd  G 
cm  o 
<2J  (J 


I 

04 

o 

T3 

P 

&' 

o 


& 

o 

u 

a 


0) 

p 

G 

<D 


U 

03 

T3 


O 

D 


H 

O 


3m 

<D 

P 

G 

<D 


O 

M 

a 


CO 

03 

T3 

03 


U 

D 


O 

CO 


tn  A 

H  «— i 

■AB 

O  0J 


IT  cm 

V 


cd  ft  : 
S  w  A 

z 

tH 

A  S 

bP 

PS 

n  A  N 

CD  ^  V 

^  |  - 

bJ  x> 

2%Z 


O 

CO 


3-1 

a) 

p 

G 

03 


P 

i* 

o 

M 

a 


03 

•o 

03 


U 

D 


ID  di  ID 
P  G 
P  03 

•sTs 

03  n  w 

G 

Q)  -H 

M  -P 
03  C 
O 
U 


P 

CO 


CO 

-H 


<u 

u  u, 

03  -0 
P  CO 
M  O  d* 

JfiQ 

cS“ 

-H  ^ 


G 
O 
-rH  -H 

P 

03 

*•  tfl  N 


P  P 


P  T3  , 
'  G 
05 


P 

G  ^ 

O  * 
y  03 


(U 

P 

E-4  ^ 


ar' 

^5 


•°  in 
G 


P 

3-4 

03 

P  . 
£0 

cx 

X3  £ 
i — I  o 

O  3h 

u  cx 


Gi  r-4 
P  3-4 
P  03 
s  CO 

a;  o 

CD  ^  S 

G  < 

id  cm 
p  cid 
O  Q  G 


rt  ^  fa  . 


S  G> 


C-404 


TEST  #  OP-15  TESTED  BY:  _  Jock  K.  Stratton  _  DATE:  04/SEP/97  TIME:  21:06  TEST  DIRECTOR’S  INITIALS 


p 

p 

p 

p 

p 

P 

p 

p 

CO 

co 

to 

to 

CO 

CO 

to 

to 

d) 

0) 

CD 

d) 

CD 

d) 

CD 

CD 

Eh 

Eh 

Eh 

Eh 

Eh 

Eh 

Eh 

Eh 

a 

a 

a 

a 

a 

a 

a 

a 

o 

o 

0 

o 

O 

o 

o 

o 

p 

p 

p 

p 

P 

p 

p 

p 

w 

CO 

w 

w 

W 

w 

00 

CO 

CO 

to 

0 

ft 


w  o 

CM  ij 
£ 

G 


•rH 

tT1 

O 


C 

ID  *  •  s 
P  ~  " 

co  —  i  ft 

O  T3  *— * 

G> 

CO  H  **  (N 
0 

^  <D 
2  p 
e  p 


t 

c  p 
o  w 
0,  ® 

M 

O 


<0 

ft 


0 

ft 


0 

1X4 


CO 

0 

ft 


a 

. 

& 

n 

e 

3 

CD 

O 

•o 

>1 

<0 

rH 

T5 

t3*  T3 

•cj-  *0 

O'  CD 

a 

O'  CD 

G  >i 

« 

G  >i 

O  rd 

•iH 

O  to 

a  h 

T5 

&i  rH 

a 

D, 

tO  (0 

P 

CO 

to  CO 

*rt 

CD 

•  *rH 

•H 

CO  T5 

CO 

W  *0 

>. 

d) 

P 

>. 

f0  CO 

$H 

a 

to  to 

CD 

rH  *rt 

e 

rH  -H 

CO 

a 

CD 

o 

a 

£ 

C0  M 

U 

M 

CO  M 

O 

-H  CO 

m 

CD 

•H  CO 

G, 

T3 

•o 

CO 

CO 

CO 

G 

CO 

CD 

CO  < 

p 

-H 

CO  C 

ft 

ft  Q 

G 

O' 

ft  Q 

M  < 

*H 

O 

H  < 

TS 

O 

.  rH 

(D  CD 

d) 

CD  CD 

CD 

p 

x:  x: 

to 

X 

X3  X3 

u 

Eh  Eh 

P 

w 

Eh  Eh 

CD 

to 

2 

a 

•  •  •• 

■a 

D 

•  •  •• 

o  u 

o  o 

w 

D  CO 

rH 

(D 

D  CO 

M  < 

rH 

x: 

M  < 

<HJ  C2J 

< 

H 

C2J  C 22 

d) 

r—, 

(D 

P 

CH 

P 

10  • 

ft 

tO  • 

T3  CO 

TJ  CO 

3  Q 

CD  < 
G  Q 

< 

P 

< 

|  a1"  B 

g  JJ  PJ 
3  -rl  *— * 

^r=" 

3 


to  v 
p 

•H  ®  A 

a  - 


0 
*s 

■°Sl 


0 

u 

0 

Ip 

p 

a) 

P 

c 


U  ft 

0)  CO 

a. 


n  oj 
=  v 


CO 

<  H 
Q  ft 

rt!  “ 

»p 


0 

ft 


(D  ID: 

CO  rH  >, 

G  P  rH 

o  m  h 
aw  o 

W-H  3 

<y  q  73 

p  -rl 
.  > 

Q)  ^  -H 

p  tj 

El  (U  c 
rH  M 

P 

.  CO 

tj  c  to 
0)  H  4-> 
rH  5  G 

P  -H 

'SjS  §  . 

*  ®§. 


CO 


Q 


cfl 


^  Sij« 

•s°§- 

&  o  « 
D  w  -H 

4-*  rH 

<0  5  0  c 


TJ  O 
73 
0)  C 
P  -H 
H  3 


0 

a 

p 

G 

o 

CO 

0 

ft 


e 

0 

4-) 

CO 

>1 

co 

O' 

G 


o  a) 
•h  0 
O'  p 
o  (J 

ft  CO 


I  r* 
ft 


_  ft 

r 

in 

r— i  ft 

O  C5 

b  2 


V 

G  •* 

P  •• 

o  •• 

G  •« 

.. 

P 

e  •• 

P 

p 

O  U 

u 

CD  L) 

u 

P 

O  U 

u 

to 

x  cj 

CO 

•H 

CD  D 

CO 

CO  CO 

O*  CO 

•H 

a  d 

CO 

CO 

<0  CO 

d> 

(0 

-  M 

< 

CD  <C 

o  < 

tO 

-  H 

< 

■H 

rH  C 

Eh 

& 

'  G5J 

CBJ 

ft  <2J 

XI  <2J 

IS 

— -  <H2 

(22 

a 

C  <22 

a 

CD 

o 

rH 

CM 

00 

P 

CO 

rH 

r — l 

rH 

rH 

rH 

c0 

ft 


CO 

CO 

to 

ft 


to 

ft 


CO 

to 

ft 


to 

ft 


to 

ft 


CD  <D  = 

CD  0 

t 

0  0 

r 

0  0  = 

CO  rH  >i 

CO  rH 

>. 

CO  rH 

>1 

CO  rH  >1 

GflH 

G  P 

rH 

G£H 

C  P  rH 

O  <0  rH 

O  to 

rH 

O  0 

i — l 

O  0  rH 

CD  CO  fO 

a  to 

0 

CD  to 

0 

CD  CO  0 

WHO 

CO  -H 

G 

CO  -H 

G 

WHO 

ID  Q  TJ 

0  Q 

TJ 

0  Q 

TJ 

0  D  73 

P  -iH 

U 

•rH 

P 

•rl 

P  -H 

> 

> 

> 

> 

the 

ble 

Indi 

the 

ble 

•H 

T5 

G 

M 

the 

ble 

-rl 

TJ 

G 

w 

the 

ble 

Indi 

(0 

0 

0 

0 

♦  G 

•  G 

•  G 

•  c 

TJ  H  m 

r  1 

«5|  . 

TJ  W 
0  = 
*H 

P 

CO  ^ 
•H  P 

W 

P 

C 

•rH 

O 

CD 

TJ  ft 
0  S 

i — ! 

P 

•m 

•H  P 

to 

p 

G 

•H 

O 

a 

TJ  ft  M 

3  .s 

S  ®  9 
•H  ^  S1 

•0  E"  5  T3 

H“  /II 

T3  E-1 

0 

P  }3 

73  Eh 

fO  * 
p  p 

4j  0 
G  w 

•HO 
°  n 

a  ° 
to 


a  £ 

.  to 

>  rH 

Q. 

H  « 
’d  -rH 

CO 


Q 

(0 


>1 

to 


p  _i 

.2  3  0  G 
O  U  0 
73  -H  0 
fl)  G  O'W 

p  -h.  o  o 

EH  3  XI  CO 


A  r— i 

e 

r-.  CM 

p 

r* 

S  ft 

0 

ft 

rH 

Q 

< 

P 

..  XT 

0 

ft 

CO 

^  3 

i 

O 

0 

a 

r— i  ^ 

CO 

Eh 

2 

ft 

B  — 

O 

to 
p 
0 

&tT". 

■H 

<D  O  °  £  m 
P  £D  rH  P  H 

4-1 4J  &.  £  Ei 
^0  u-r  uj  uj 

a;  tj 


CO 


<1> 

p 

to 

5 

73 

P 

to 

ft 


ft  = 


£i  04 

ft 


8S 

ft  H 


P 

G 

•H 

O 

to 

O 

rH 

Unit 

CO 

-H 

P 

p 

G 

■H 

O 

CO 

o 

rH 

Unit 

CO 

•H 

TJ 

p 

G 

•H 

O 

CO 

o 

rH 

Unit 

dis] 

a 

0 

U 

w 

-H 

a 

0 

u 

CO 

•rl 

& 

u 

CO 

•rH 

p 

rH 

p 

rH 

P 

rH 

0 

s 

0 

c 

0 

0 

G 

0 

3 

0  C 

TJ 

o 

o 

0 

TJ 

o 

u 

0 

73 

O 

U  0 

73 

•H 

0 

73 

•rH 

0 

73 

•H  0 

0 

G 

Co 

p 

0 

G 

O' 

P 

0 

C 

CT>  p 

P 

•H 

o 

u 

P 

•H 

o 

U 

P 

•H 

o  u 

Eh 

ft 

to 

Eh 

3 

ft 

CO 

Eh 

3 

ft  co 

ft 

CO 

l__) 

ft 

ft 

ft 

r- 

ft 

r- 

Q 

ft 

£ 

ft 

•rtj 

ft 

*— * 

S 

i-j 

P 

P 

C 

G 

i— * 

P 

G 

r— i 

•H 

ft 

•rH 

ft 

ft 

O 

CO 

o 

w 

CO 

a 

0 

CD 

0 

O 

a 

0 

t-J 

p 

P 

0 

0 

p 

Q 

I 

a 

CO 

| 

0 

D 

1 

CO 

CO 

G 

G 

C 

O 

O 

o 

•rH 

A 

-H 

A 

•H 

A 

P 

r— i 

P 

i— i 

P 

r— i 

0 

*z 

0 

Z 

0 

z 

U 

3 

U 

3 

o 

3  » 

•H 

Q 

- 

•H 

Q 

- 

■rH 

o  - 

G 

G 

P 

D 

co 

G 

G 

P 

E 

CO 

— i 

G 

G 

P 

H 

O  . 

o ! 

ft 

ft 

Q 


n  ft 
v 


„  u  < 


cn  ft 
v 


55  ft  co  ^  Z  ft 

®“  a  ill 


O  rH 
U  < 

ft  0 
ft 


00  ft 

V 


r- ,  04 

z  ft 


p  £ 
p  . 

p  . 
c  * 

0  -h  - 

rH  O 

p  a  •• 

to  to  CJ 
CO  P  CO 
•H  ID  < 
Q  73  <22 


CO 

p 

w  p 

CO 

0 

CO 

•p 

0 

«  _  -H 

0 

CO 

P 

P 

^  a 
s  r 

§ 

p 

p 

^  S  nt 

P 

P 

0 

£ 

TJ 

73  ^ 

TJ 

0 

0 

0 

0 

0 

0 

rH 

p 

rH 

P 

rH 

P 

P 

o  .. 

P 

O  •• 

P 

o 

0 

0  CJ 

0 

0  U 

0 

0 

CO 

■r-i  CO 

CO 

•r— i  CO 

CO 

•r-> 

-rH 

0  < 

•H 

0  < 

•H 

0 

Q 

ft  <22 

Q 

ft  <22 

Q 

ft 

u> 

r* 

00 

i — i 

rH 

rH 

ro  22.  ^ 

jj 

•H 

f 


C-405 


19.  Disable  the  AWOS  Station  ADAS  Error  Alert.  The  datapoint  is  disabled,  the  response  [X]  Pass  [  ]  Fail  Stop  Test 

@ASC :  "A  [RTN]  [Shft-K]  001  [RTN]  <9:[DOWN]>  window  closes.  The  "Enable  Disable 

[RTN]  [SP]  [F7]  (wait)  [F2]  [F14J"  Logical  Unit  Datapoints  Individually” 

screen  is  displayed. 
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For  the  next  60  seconds,  dequeue  all  Events,  There  should  be  No  EVENT  TYPE  18’ s  after  [X]  Pass  [  ]  Fail  Stop  Test 

press  PrintScreen  if  EVENT  TYPE  18.  the  time  just  recorded  for;  AM 

@ASC:  "  [F6]  [F8]  {  [F2]  if  EVENT  TYPE  18)  [F14]  RESOURCES,  DISK  SPACE,  DLP/WARP 
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50.  SPatch  Panel:  Move  patch  cord  from  ADAS  SEP  The  PC  will  now  capture  IPS  output.  [X]  Pass  [  ]  Fail  Re-connect 

port  to  the  IPS  LOG  port.  Patch  Cable 
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C.7.14.  TEST  OP-16  -  Checkpoint  and  Shutdown  Processing 

The  following  paragraphs  provide  information  about  data  associated  with  this 
test  but  not  included  within  the  main  body  of  this  report. 


C.7.14.1.  Associated  Evaluation  Criteria  and  Data 

The  following  Evaluation  Criteria  were  used  to  determine  the  requirements 
passed/f ailed.  The  Cross  Reference  (CR)  numbers  can  be  used  to  trace  into  the 
data  found/referenced  below. 


Pass  Fail 

[XX]  [  ]  Each  procedure  step's  "pass"  box,  in  the  ’Observed  Results' 

column,  was  marked,  indicating  the  'Expected  Response'  was 
observed.  (See  Appendix  C  for  the  test  procedure  performed 
for  test  OP-16 . ) 

[XX]  [  ]  The  ADAS  Event  Log  Report,  for  Event  Type  15  entries,  will 

indicate  the  failed  mission  cycle (s). 

A  normal  mission  cycle  will  generate  an  event  type  15  entry 
("One  of  the  one  minute  cycle  phases  has  begun"),  in  the 
Event  Log,  for  each  of  the  following  six  phases:  mission 
CR1-1,  completion  sip  CR1-2,  completion  archival  CR1-3, 
completion  maintenance  CR1-4,  completion  chkpt  CR1-5,  and 
idle  CR1-6. 


The  terminated  mission  phase  CR2  will  be  followed  by  a  2nd 
mission  phase  CR3,  with  no  intervening  mission  cycle  phases. 
Record  the  ' EVENT  SEQ.  NUMBER'  and  'DATE/TIME  STAMP'  from 
the  the  two  consecutive  mission  phase  event  log  entries. 
CR2A,  CR2B,  CR3A,  &  CR3B 

Incomplete  Mission  Cycle:  EVENT  SEQ.  NUMBER  296 

DATE/TIME  STAMP:  09-04-97  23:02:00 

Next  Mission  Cycle  Event:  EVENT  SEQ.  NUMBER  485 

DATE/TIME  STAMP:  09-04-97  23:04:00 

[XX]  [  ]  The  METAR  reports  sent  to  the  WMSCR  simulator  must  show  data 

only  from  completed  cycles. 

Inspect  each  of  the  hourly  METAR  messages  following  the 
terminated  mission  phase  and  verify  that  the  Rain  begin/end 
data  does  not  appear  for  minute  01  (RB01  or  RE01)  .  CR4-1, 

CR4-2,  CR4-3,  CR4-4,  &  CR4-5  ~ 


The  following  data,  marked  with  evaluation  criteria  cross-reference  numbers, 
is  a  subset  of  the  OT&E  formal  test  run  data.  Other  relavent  data  has  been 
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included  into  OP-16's  Test  Conduct  Form  (TCF)  file,  "OP-16. TCF". 

adas  16179  18175  0  21:51:23  ?  0:00  /usr/adas/adasrun/bin/mcc_ctl 

Press  return  to  kill  "mcc_ctl"  #  Sep  4  @  21:52:51 

SIGKILL  sent  to  process  "mcc_ctl"  #  Sep  4  @  23:02:13 

adas  18408  18406  0  23:02:44  ?  0:00  /usr/adas/adasrun/bin/sl_ctl 

Press  return  to  kill  "sl_ctl"  #  Sep  4  @  23:04:07 
SIGKILL  sent  to  process  "sl_ctl"  #  Sep  5  0  00:02:48 

adas  18599  18592  0  00:03:21  ?  0:00  /usr/adas/adasrun/bin/wsp_ctl 

Press  return  to  kill  "wsp_ctl"  #  Sep  5  0  00:04:45 

SIGKILL  sent  to  process  "wsp_ctl"  #  Sep  5  0  01:02:38 

EVENT  PRIORITY:  normal  DATE/TIME  STAMP:  09-04-97  21:53:00 

EVENT  SEQ.  NUMBER:  72  EVENT  TYPE:  15 _ CSC  ID:  12.01 

One  of  the  one  minute  cycle  phases  has  begun. 

phase:  mission _  _ _ _ _ _  _ _ _ _ _ _ _ 

EVENT  PRIORITY:  normal  DATE/TIME  STAMP:  09-04-97  21:53:18 

EVENT  SEQ.  NUMBER:  73  EVENT  TYPE:  15 . CSC  ID:  12.01 

One  of  the  one  minute  cycle  phases  has  begun. 

phase:  completion  sip _ . . . . . . . . . 


EVENT  PRIORITY:  normal  DATE/TIME  STAMP:  09-04-97  21:53:18 

EVENT  SEQ.  NUMBER:  74  EVENT  TYPE:  15 _ CSC  ID:  12.01 

One  of  the  one  minute  cycle  phases  has  begun. 

phase:  completion  archival _ _ 

EVENT  PRIORITY:  normal  DATE/TIME  STAMP:  09-04-97  21:53:18 

EVENT  SEQ.  NUMBER:  91  EVENT  TYPE:  15 .  CSC  ID:  12.01 

One  of  the  one  minute  cycle  phases  has  begun. 

phase:  completion  maintenance  .  .  . . . . . . 

EVENT  PRIORITY:  normal  DATE/TIME  STAMP:  09-04-97  21:53:21 
EVENT  SEQ.  NUMBER:  250  EVENT  TYPE:  15 CSC  ID:  12.01 
One  of  the  one  minute  cycle  phases  has >  begun. 

phase:  completion  chkpt _ 

EVENT  PRIORITY:  normal  DATE/TIME  STAMP:  09-04-97  21:53:28 

EVENT  SEQ.  NUMBER:  251  EVENT  TYPE:  15 . CSC  ID:  12.01 

One  of  the  one  minute  cycle  phases  has  begun. 


phase:  idle  time 


CR1-3 


CR1-4 


CH 


1-5 


CRl-6 


EVENT  PRIORITY:  normal  DATE/TIME  STAMP:  09-04-97  23:02:00 

EVENT  SEQ.  NUMBER:  296  EVENT'"tYPEI'"15 .  CSC  ID:  12.01 

One  of  the  one  minute  cycle  J?hases__has__begun. 

pha s e :  mis s ion 


GR2B 


UR2A 


CR2 


EVENT  PRIORITY:  normal  DATE/TIME  STAMP:  09-04-97  23:04:00 _ C|R3B 
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EVENT  SEQ.  NUMBER:  485  EVENT  TYPE:  15  CSC  ID:  12.01  dR3A 


One  of  the  one  minute  cycle  phases  has  begun, 
phase:  mission 


91  3  METAR  K001  050000Z  AUTO  04005G15KT  7SM  R01/3000FT  -DZ  22/06  A2998  Clj4-1 

92  3  RMK  AO 2  DZ B 0 4 B 5 9  SLP000  PWINO  . . . C^4-l 

117  4  METAR  K002  050000Z  AUTO  04005G15KT  7SM  R01/3000FT  -RA  22/06  A2998  CF}4-2 

118  4  RMK  A02  RAB04B59  SLP000  PWINO  FZRANO  C$4- 2 

85  3  METAR  K003  050000Z  AUTO  04005G15KT  7SM  R01/3000FT  -DZ  22/06  A2998  Cr}4-3 

86  3  RMK  AO 2  DZB04B59  SLP000  PWINO  _ _ CF^-l 

88  3  METAR  K004  050000Z  AUTO  04005G15KT  7SM  R01/3000FT  -DZ  22/06  A2998  Cf}4-4 

89  3  RMK  A0 2  5 ZB 04 B 5 9  SLP000  PWINO .  . 'cf4-4 

82  3  METAR  K005  050000Z  AUTO  04005G15KT  7SM  R01/3000FT  -DZ  22/06  A2998  0^4-5 

83  3  RMK  A0 2 "DZB04B59  SLP000  PWINO  . Cl  4-5 
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C.7.15.  TEST  OP-17  -ASC  Display  Response 

The  following  paragraphs  provide  information  about  data  associated  with  this 
test  but  not. included  within  the  main  body  of  this  report. 


C.7.15.1.  Associated  Evaluation  Criteria  and  Data 

The  following  Evaluation  Criteria  were  used  to  determine  the  requirements 
passed/failed.  The  Cross  Reference  (CR)  numbers  can  be  used  to  trace  into  the 
data  found/referenced  below. 

Pass  Fail 

a-  t30^  t  1  Each  procedure  step's  "pass"  box,  in  the  'Observed  Results' 

column,  was  marked,  indicating  the  'Expected  Response'  was 
observed.  (See  Appendix  C  for  the  test  procedure  performed 
for  test  OP-17. ) 

b.  [XX]  [  ]  Calculate  the  average  of  all  30  recorded  times. 

{ SUM/ 3 0=AVG )  _ 24.78 _  /  30  =_.826_ 

c.  [XX]  [  ]  Calculate  the  average  of  the  29  lowest  recorded  times. 

{ (SUM-MAX) /29=AVG)  _22.71_  /  29  =  _.783_ 

[  ]  The  times  noted  for  each  display  response  should  be  totaled. 

e.  [XX]  [  ]  The  average  of  all  response  times  must  be  less  than  3 

seconds. 

f-  t30^  [  ]  95%  of  the  responses  (the  29  shortest)  must  be  less  than  1 

second. 

Because  of  the  short  timing  intervals  and  the  variance  of  reaction  times  from 
individual  to  individual,  the  calculated  average  will  obviously  not  be  exact. 
While  a  +/-  tolerance  was  ideal,  the  determination  of  a  realistic  factor  for 
human  reaction  times  was  not  within  the  scope  of  this  document.  However 
reaction  times  may  be  on  the  order  of  .25  seconds  per  sample. 

Relavent  data  has  been  included  into  OP-17 's  Test  Conduct  Form  (TCF)  file 
"OP-17. TCF".  ' 
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Repeat  steps  in  the  above  LOOP  four  more  times  Pass  1  completed:  [x]  Pass  [  ]  Fail  Stop  Test 

(total  of  5)  before  preceding  to  the  next  step.  Pass  2  completed:  [X]  Pass  [  ]  Fail 

Pass  3  completed:  [X]  Pass  [  ]  Fail 

Pass  4  completed: 
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C.7.16.  TEST  OP-18  -  ASC  Intrusive  Update  response 

The  following  paragraphs, provide  information  about  data  associated  with  this 
test  but  not  included  within  the  main  body  of  this  report. 


C.7.16.1.  Associated  Evaluation  Criteria  and  Data 

The  following  Evaluation  Criteria  were  used  to  determine  the  requirements 
passed/failed.  The  Cross  Reference  (CR)  numbers  can  be  used  to  trace  into  the 
data  found/referenced  below. 


Pass  Fail 


[XX]  [  ]  Each  procedure  step's  "pass"  box,  in  the  'Observed  Results' 

column,  was  marked,  indicating  the  'Expected  Response'  was 
observed.  (See  Appendix  C  for  the  test  procedure  performed 
for  test  OP-18 . ) 


b. 


c. 


d. 


e. 


[XX]  [ 
[XX]  [ 

[XX]  [ 
[XX]  [ 


]  Total  the  30  recorded  times.  Total  Response  Time:  _ 

]  Identify  the  longest  response  time  and  subtract  it  from  the 
total.  95#  Time:  _ 

]  Divide  the  Total  Response  Time  by  30.  Avg  Time:  _ 

]  Divide  the  95 -  Time  by  29.  95%  Avg:  _ _ _ 


f.  [XX] 


]  The  average  of  all  response  times  (Avg  Time)  must  be  less 
than  30  seconds. 


g.  [XX] 


95%  of  the  responses  (95%  Avg)  must  be  less  than  one  minute. 


Relevant  OT&E  formal  test  run  data  has  been  included  into  OP-18 's  Test  Conduct 
Form  (TCF)  file,  "OP-18. TCF". 
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confirmation  of  the  installation  request  to  1.  _ 

when  the  response  window  begins  to  be  12.  _ 

displayed.  23.  _ 

@ASC:  " [F9]  [SP]  [RTN]  {wait  &  record}  [F14]"  The  "Adaptation  Commands"  screen 

displayed. 
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24.  Set  the  Miscellaneous  System  Characteristics  fl  response  window  indicating  success,  [X]  Pass  [  ]  Fail  Stop  Test 

Critical  Restarts  field  to  5.  the  "Adaptation  Commands"  screen  is 

@ASC:  " [F8]  MMM  [RTN]  <8:[DOWN]>  5  <4:[D0WN]>  displayed. 

[RTN]  {wait)  [F14]" 
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C.8.  CATEGORY  PT  -  ADAS  Mods  PTRs  &  Site  Issues 

A  category  PT  test  was  created  for  of  the  9  ADAS/Mods  OT&E  PTR  and  6  ADAS  Site 
Issue  (SI)  specified  in  the  ADAS/ALDARS  Contract  Statement  of  Work  (SOW)  . 
Instead  of  test  procedure  steps,  the  PT  tests  tracked  the  evaluation  of  ADAS 
with  respect  to  the  SOW  PTRs  and  Sis.  For  complete  data  and  information, 
refer  to  paragraph  4.4.8  in  this  report. 


C.9.  CATEGORY  RA  -  Reliability  and  Availability  Tests 


C.9.1  TEST  RA-01  -  Reliability  and  Availability 

The  following  paragraphs  provide  information  about  data  associated  with  this 
test  but  not  included  within  the  main  body  of  this  report. 


C.9.1. 1  Associated  Evaluation  Criteria  and  Data 

The  following  Evaluation  Criteria  were  used  to  determine  the  requirements 
passed/failed.  The  Cross  Reference  (CR)  numbers  can  be  used  to  trace  into  the 
data  found/referenced  below. 


[  ]  Each  test  procedure  step's  "pass"  box,  in  the  'Observed 

Results  column,  is  marked,  indicating  the  'Expected 
Response'  was  observed  and/or  the  correct  action  was 
performed  successfully.  (See  Appendix  C  for  the  test 
procedures  performed  for  this  test) . 

[  ]  The  Mean  Time  Between  Failure  shall  equal  to  or  greater  than 
2190  hours  .  NAS-SS-1^  Vol .  I  Table  3. 2. 2. 1-1 

[  ]  The  availability  shall  equal  to  or  greater  than  0.99973 

percent . NAS-SS-1000,  Section  3.2.4,  Vol . I  Table  3.2.2. 1-1 


Pass 

a.  [X] 

b.  [x] 

c.  (X] 


All  relevant  OT&E  formal  test  run  data  has  been  included  into  test  RA-01' s 
Test  Conduct  Form  (TCF)  file,  "RA-01. TCF". 


C.9.1. 2  TCF  Test  Procedure  Steps 

The  Following  test  procedure  steps,  referenced  by  evaluation  criteria  "a"  of 
this  test's  Data  Reduction  and  Analysis  Method  paragraph  in  the  main  body  of 
this  report,  were  extracted  from  test  procedure  file  "RA-01 .TCF" . 
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STEP 

DESCRIPTION 

VER. 

DATE 

TIME 

m 

Record  the  version  number  of  ADAS  Operational 
Software. 

n 

12/8/97 

08:00  AM 

2 

Record  the  version  number  of  NLDN  Operational 
Software . 

9.41 

12/8/97 

08:00  AM 

3 

Record  the  time  and  date  for  beginning  of  test. 

B 

12/8/97 

08:00  AM 

4 

Record  the  time  and  date  for  stoppina  of  test. 

B 

3/13/98 

08:00  AM 

5 

Record  the  time  and  date  for  beainnina  of 
downtime. 

B 

6 

Record  the  time  and  date  for  stoppina  of 
down  t  ime .  • 

4.19 

MTBF  =  total  number  of  measured  hours/#  of  failures 
MTTR  =  total  #  amount  of  downtime/#  of  failures 
Availability  =  MTBF/ (MTBF+MTTR) 

The  total  of  test  time  =  95  days  =  2280  hours 
The  total  of  down  time  =  0  hour 
MTTR  =  0  hour 

Reliability  =  MTBF  =  2280  hours  >  2190  hours 

Availability  =  MTBF/ (MTBF+MTTR)  =  2280/(2280  +0)  =  1  >  0.99973 


C.10.  CATEGORY  ST  -  Stress  Tests 
C.10.1.  TEST  ST-01  -  All  Stations  Nominal 

The  following  paragraphs  provide  information  about  data  associated  with  this 
test  but  not  included  within  the  main  body  of  this  report. 


C.10.1. 1.  Associated  Evaluation  Criteria  and  Data 

The  following  Evaluation  Criteria  were  used  to  determine  the  requirements 
passed/failed.  The  Cross  Reference  (CR)  numbers  can  be  used  to  trace  into  the 
data  found/referenced  below. 


Pass  Fail 

[XX]  [  ]  Each  procedure  step's  "pass"  box,  in  the  'Observed  Results' 

column,  was  marked.  (See  Appendix  C  for  the  test  procedure 
performed  for  test  ST-01.) 
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[XX]  [  ]  The  DISPLAY  EVENT/ERROR  LOG  PARAMETERS  screen  print  must 

indicate  zero  records  in  the  error  log  _CR9,  and  the  EVENT 
LOG  DATA  REQUEST  FOR  PRINTER  OUTPUT  for  Event  type  17  CR10, 
and  its  RESPONSE  CR11  screen  prints  must  indicate  there  are 
no  Event  Type  17' s  entries. 

[XX]  [  ]  The  length  of  the  processing  phase  (the  mission  phase  of  the 

mission  cycle)  must  not  exceed  26.7  (27  due  to  the  one 

second  resolution  of  the  system  timing) .This  was  calculated 
from  the  ADAS  Events  indicating  the  beginning  of  the  mission 
phase  timestamp  CR1  subtracted  from  the  beginning  of  the 
completion  sip  phase  timestamp  CR2,  for  mission  cycle  of  the 
test .  . 


[XX]  [  ]  The  DLP  CR3  and  ITWS6  CR4  DR  summary  files  must  indicate  | 
that  75  messages  are  received  each  mission  cycle.  The 
number  of  messages  DLP 

(CR3  =  CR4  =  75  *  { #_of_mission_cycles } ) .  I 


e  [XX]  [  ]  Unless  the  hourly  minute  was  crossed,  the  WMSCR  Metar  log 

CR5  will  indicate  that  no  messages  were  received  during  this 
test.  If  the  hourly  minute  was  crossed, the  WMSCR  Metar  log 
will  indicate  that  the  25  AWOS  sites'  ADAS-generated  hourly 
Metar  reports  were  received. 

f  [XX]  [  ]  The  MPS  simulator  log  must  show  that  no  METAR  5  second 

alarms  (LU  #24,  DP#  05  =  0  CR7  )  or  10  second  alarms  (LU#24, 
DP#04  =  0  CR8  )  were  generated,  i.e'.  the  MPS  ALARM  Log  does 

not  contain . alarm  entries  for  5  or  10  second  throughput 

alarms . 

The  following  data  marked  with  evaluation  criteria  cross-reference  numbers  is 
a  subset  of  the  relevant  OT&E  formal  test  run  data  that  has  been  included  into 
ST-01' s  Test  Conduct  Form  (TCF)  file,  "ST-01. TCF". 


02-13-98  02:27:11 

.  Events : 

1  .  Responses: 

0  .  EVENT/ ERROR  CMDS 

DISPLAY  EVENT/ERROR  LOG  PARAMETERS 


ERROR  LOG  FILE  PATHNAME:  /usr/adas/adasrun/data/SL/erl 

EVENT  LOG  FILE  PATHNAME:  /usr/adas/adasrun/data/SL/evl 

ERROR  LOG  RLLOVER  FILE  PATHNAME:  /usr/adas/adasrun/data/SL/erl . ro 
EVENT  LOG  ROLLOVER  FIL  PATHNAME:  /usr/adas/adasrun/data/SL/evl . ro 

FILE  NAME:  BYTE  SIZE:  RECORD  COUNT:  DATE/TIME  LAST  UPDATE: 


erl 


0 


evl  89816 
erl.ro  0 
evl . ro  0 


1956 . Fri  Feb  13  02:27:07  1998 

0  Thu  Jan  1  00:00:00  1970 
0  Thu  Jan  1  00:00:00  1970 
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F7 


F8 


F9  .  F10  .  Fll  .  F12 


FI  3 


EXIT 
F14  . 


02-13-98  02:27:24  .  Events:  2  .  Responses: 


0  .  EVENT/ERROR  CMDS 


EVENT  LOG  DATA  REQUEST  FOR  PRINTER  OUTPUT 
_ PRIMARY  SEARCH  KEY  DATA: 

. . . . START  DATE:  02/13/98 . STOP  DATE :  02/13/98 

. START  TIME:  00:00 : 6 0  STOP  TIME: 02:27:17 

_ SECONDARY  SEARCH  KEY  DATA: 

. . BEGIN  EVENT  SEQUENCE  NUMBER:  0 

. . END  EVENT' '"sEQUENCE"NUMBER: . . . 0 

_ _ EVENT  "TYPE’: . . . .  yj~ . 

ENTER  INTEGER  VALUE  FOR  THE  EVENT  TYPE  NUMBER. 


EXIT 

F9  F10  .  Fll  .....  F12  .....  F13  .  F14  . 


02  13  98  02:27:24  .  Events:  2  .  Responses:  0  .  EVENT/ERROR  CMDS 


RESPONSE . CONTROL  MESSAGE  STATUS 


. 

COMMAND  NAME: 

[REPORT 

EVNT/ERR 

LOG] 

-- 

RESPONSE 

STATUS: 

FAILURE 

REMARKS : 

THERE  IS  NO 

EVENT/ ERROR 

LOG 

DATA  MATCHING  THE  SEARCH  KEYS. 

PRESS 

EXIT 

KEY 

TO 

QUIT 

CR1 1 

WINDOW. 

•  •  •  • 

.  .  .  F7 

.  .  F10  _ _ 

Fll 

-  F13  . . . 

EXIT 

.  .  F14  . 

EVENT  PRIORITY:  normal  DATE/TIME  STAMP:  02-13-98  02:18:02 
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EVENT  SEQ.  NUMBER:  74  EVENT  TYPE:  15 . CSC  ID:  12.01 

One  of  the  one  minute  cy_cle_jphas_es___hM___b^un. 

phase:  mission  _ _ _ 

EVENT  PRIORITY:  normal  DATE/TIME  STAMP:  02-13-98  02:18:09 

EVENT  SEQ.  NUMBER:  76  EVENT  TYPE:  15 _ CSC  ID:  12.01 

One  of  the  one  minute  cYclephaseshasbeg 

phase:  completion  sip . 

EVENT  PRIORITY:  normal  DATE/TIME  STAMP:  02-13-98  02:19:00 
EVENT  SEQ.  NUMBER:  1868  EVENT  TYPE:  1 5 CSC  ID:  12.01 
One  of  the  one  minute  cycle  phases  has  begun. 

phase:  mission  . . . . . 

EVENT  PRIORITY:  normal  DATE/TIME  STAMP:  02-13-98  02:19:08 

EVENT  SEQ.  NUMBER:  1870  EVENT  TYPE:  15 _ _  CSC  ID:  12.01 

One  of  the  one  minute  cycle  phases  has  begun. 


phase:  compl e t i on  s lp . . . 

EVENT  PRIORITY:  normal  DATE/TIME  STAMP:  02-13-98  02:20:00 

EVENT  SEQ.  NUMBER:  18  81  EVENT  TYPE:  15 . CSC  ID:  12.01 

One  of  the  one  minute  cycle  phases  has  begun. 

phase:  mission _ _ _ _ _ _ ; _ _____ _ 

EVENT  PRIORITY:  normal  DATE/TIME  STAMP:  02-13-98  02:20:08 

EVENT  SEQ.  NUMBER:  1883  EVENT  TYPE: 15 _ CSC  ID:  12.01 

One  of  the  one  minute  cycle  phases  has  begun. 

phase:  completion  sip  -  . . . 

EVENT  PRIORITY:  normal  DATE/TIME  STAMP:  02-13-98  02:21:00 

EVENT  SEQ.  NUMBER:  1891  EVENT  TYPE:  15 . ; . CSC  ID:  12.01 

One  of  the  one  minute  c y c lep haseshas  begun . 

phas  e :  _  mission  . . . . . . 

EVENT  PRIORITY:  normal  DATE/TIME  STAMP:  02-13-98  02:21:08 

EVENT  SEQ.  NUMBER:  1892  EVENT  TYPE:  15 _ CSC  ID:  12.01 

One  of  the  one  minute  cycle  phases  has  begun. 

phase:  completion  sip  ' . . . 

EVENT  PRIORITY:  normal  DATE/TIME  STAMP:  02-13-98  02:22:00 

EVENT  SEQ.  NUMBER:  1899  EVENT  TYPE:  15 . CSC  ID:  12.01 

One  of  the  one  minute  cycle  phases  has  begun. 

phase:  mission  _ _ _ 

EVENT  PRIORITY:  normal  DATE/TIME  STAMP:  02-13-98  02:22:07 

EVENT  SEQ.  NUMBER:  1900  EVENT  TYPE:  15 _ CSC  ID:  12.01 

One  of  the  one_minute  cycljejphaises__ha;s__be2un;_ 

phase :  completion  sip . . . ; . 
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EVENT  PRIORITY:  normal  DATE/TIME  STAMP:  02-13-98  02:23:01 
EVENT  SEQ.  NUMBER:  1908  EVENT  TYPE;  15  CSC  ID:  12.01 
One  of  the  one  minute  cycle  phases  has  begun. 

phase:  mission 


EVENT  PRIORITY:  normal  DATE/TIME  STAMP:  02-13-98  02:23:07 
EVENT  SEQ.  NUMBER:  1909  EVENT  TYPE:  15  CSC  ID:  12.01 

cYcle  phases  has  begun! .  ”  . 

phase:  completion  sip _ 


EVENT  PRIORITY:  normal  DATE/TIME  STAMP:  02-13-98  02:24:00 
EVENT  SEQ.  NUMBER:  1917  EVENT  TYPE:  15  CSC  ID:  12.01 

One  of  the  one  minute  cycle  phases  has_begun. 

phase:  mission 

EVENT  PRIORITY:  normal  DATE/TIME  STAMP:  02-13-98  02:24:08 
EVENT  SEQ.  NUMBER:  1918  EVENT  TYPE:  15  CSC  ID:  12.01 

cycle  phases  has  begun. 

phase:  completio n  sip 


EVENT  PRIORITY:  normal  DATE/TIME  STAMP:  02-13-98  02:25:00 

EVENT  SEQ.  NUMBER:  1927  EVENT  TYPE:  15 CSC  ID:  12.01 

One  of  the  one  minute  cycle  phases  has  begun. 

phase :  mi s s i o n 

EVENT  PRIORITY:  normal  DATE/TIME  STAMP:  02-13-98  02:25:08 
EVENT  SEQ.  NUMBER:  1929  EVENT  TYPE:  15  CSC  ID:  12.01 

One  of  the  one  minute  cycle  pha ses  ha s  begun ! . 

phase:  completion  sip 


EVENT  PRIORITY:  normal  DATE/TIME  STAMP:  02-13-98  02:26:00 

EVENT  SEQ.  NUMBER:  1940  EVENT  TYPE:  15 _ CSC  ID:  12.01 

One  of  the  one _ minute  cycle  phases  has  begun. 

phase:  mission 

EVENT  PRIORITY:  normal  DATE/TIME  STAMP:  02-13-98  02:26:07 
EVENT  SEQ.  NUMBER:  1943  EVENT  TYPE:  15  CSC  ID:  12.01 

cycle  phases  has  begun. 

phase:  completion  sip 

EVENT  PRIORITY:  normal  DATE/TIME  STAMP:  02-13-98  02:27:00 
EVENT  SEQ.  NUMBER:  1954  EVENT  TYPE:  15  CSC  ID:  12.01 

One  of  the  one  minute  cycle  phases  has  begun. 

phase:  mission 


EVENT  PRIORITY:  normal  DATE/TIME  STAMP:  02-13-98  02:27:08 
EVENT  SEQ.  NUMBER:  1957  EVENT  TYPE:  15  CSC  ID:  12.01 

One  of  the  one  minute  cycle"phase¥''has"Teaun" . 
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phase:  completion  sip . . . . . . . . 

#####FILE:  /usr/ips/aldars/tst/ST-01/ ST-01C. sumME  #  Feb  13  @  02:59:51 
-rw-rw-r—  1  aldars  adasteam  156  Feb  13  02:38  ST-01C. sumME 
#####START  of  file  framing  line  ##### 

DR  of  ST-01C.METAR  for  #  of  Metar  reports  per  site 


Total  Site  Reports  Processed . s  0 

Total  numb e r  of  sites  _ _ =  0 . ... . . . . . . 

Site_ID  #_of_msgs  (6  per  line) 

#####END  of  file  framing  line  ##### 

#####FILE:  /us r/ips /aldars/ tst/ ST-01/ST-01C . sumDL  #  Feb  13  @  02:59:52 
-rw-rw-r—  1  aldars  adasteam  9525  Feb  13  02:49  ST-01C. sumDL 
#####START  of  file  framing  line  ##### 

DR  of  ST-01C . DLPAW  for  messages/site  count. 


ADU# :  1  I 

(IPS) : 

02/13/98 

02:18:12 

- 

(ADAS) : 

02/13/98 

02:18:12  | 

msgs 

55 

ADU# :  2  | 

(IPS) : 

02/13/98 

02:18:18 

- 

(ADAS)  : 

02/13/98 

02:18:18  | 

msgs 

2U 

ADU#:  3  | 

(IPS) : 

02/13/98 

02:19:12 

- 

(ADAS) : 

02/13/98 

02:19:12  | 

msgs 

55 

ADU# :  4  | 

(IPS) : 

02/13/98 

02:19:17 

- 

(ADAS) : 

02/13/98 

02:19:17  j 

msgs 

2U 

ADU# :  5  I 

(IPS) : 

02/13/98 

02:20:05 

- 

(ADAS) : 

02/13/98 

02:20:05  | 

msgs 

55 

ADU# :  6  | 

(IPS) : 

02/13/98 

02:20:18 

- 

(ADAS )  : 

02/13/98 

02:20:18  I 

msgs 

20 

ADU# :  7  | 

(IPS) : 

02/13/98 

02:21:06 

- 

(ADAS) : 

02/13/98 

02:21:06  j 

msgs 

55 

ADU# :  8  | 

(IPS) : 

02/13/98 

02:21:18 

- 

(ADAS) : 

02/13/98 

02:21:18  | 

|  msgs 

20 

ADU# :  9  1 

(IPS) : 

02/13/98 

02:22:13 

- 

(ADAS)  : 

02/13/98 

02:22:13  | 

|  msgs 

55 

ADU#:  10  j 

(IPS) : 

02/13/98 

02:22:19 

- 

(ADAS)  : 

62/13/98 

02:22:19  1 

i  msgs 

20 

ADU#:  11  I 

(IPS) : 

02/13/98 

02:23:14 

- 

(ADAS)  : 

02/13/98 

02:23:14  I 

|  msgs 

bb 

ADU# :  12  j 

(IPS) : 

02/13/98 

02:23:18 

- 

(ADAS) : 

02/13/98 

02:23:18 

|  msgs 

20 

ADU#:'  13  j" 

(IPS) : 

02/13/98 

02:24:07 

- 

(ADAS) : 

02/13/98 

02:24:07 

j  msgs 

55 

ADU# :  14  | 

(IPS) : 

02/13/98 

02:24:19 

- 

(ADAS) : 

02/13/98 

02:24:19 

|  msgs 

20 

ADU#:  15  I 

(IPS) : 

02/13/98 

02:25:16 

- 

(ADAS ) : 

02/13/98 

02:25:16 

I  msgs 

bb 

ADU#:  16  | 

(IPS) : 

02/13/98 

02:25:24 

- 

(ADAS) : 

02/13/98 

02:25:24 

|  msgs 

20 

ADU#:  17  | 

(IPS) : 

02/13/98 

02:26:15 

- 

(ADAS )  : 

02/13/98 

02:26:15 

|  msgs 

55 

ADU#:  18  | 

(IPS) : 

02/13/98 

02:26:28 

- 

(ADAS) : 

02/13/98 

02:26:28 

|  msgs 

20 

ADU#:  19  I 

(IPS) : 

02/13/98 

02:27:18 

- 

(ADAS) : 

02/13/98 

02:27:18 

|  msgs 

55 

ADU#:  20  | 

(IPS) : 

02/13/98 

02:27:28 

- 

(ADAS) : 

02/13/98 

02:27:28 

I  msgs 

20 

ADU#:  21  I 

(IPS) : 

02/13/98 

02:28:15 

- 

(ADAS) : 

02/13/98 

02:28:15 

j  msgs 

55 

ADU#:  22  | 

(IPS) : 

02/13/98 

02:28:29 

- 

(ADAS) : 

02/13/98 

02:28:29 

|  ms  gs 

20 

ADU#:  23  j 

(IPS)  : 

02/13/98 

02:29:13 

- 

(ADAS) : 

02/13/98 

02:29:13 

j  msgs 

55 

ADU#:  24  | 

(IPS)  : 

02/13/98 

02:29:24 

_ 
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11.  After  the  test  terminates,  shutdown  ADAS.  [X]  Pass  [  ]  Fail  Stop  Test 

@IS1:  "{wait}  CF7]  <2:[F14]>"  The  TSI  displays  its  default  screen. 

@AUC  'adas'  prompt:  enter  ' stop^adas1  The  ADC  indicates  the  ADAS  is  DOWN. 
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C.10.2.  TEST  ST-02  -  All  Stations  Adverse 

The  following  paragraphs  provide  information  about  data  associated  with  this 
test  but  not  included  within  the  main  body  of  this  report. 


C.10.2.1.  Associated  Evaluation  Criteria  and  Data 

The  following  Evaluation  Criteria  were  used  to  determine  the  requirements 
passed/failed.  The  Cross  Reference  (CR)  numbers  can  be  used  to  trace  into  the 
data  found/referenced  below. 

Pass  Fail 

Each  procedure  step's  "pass"  box,  in  the  'Observed  Results’ 
column,  was  marked,  indicating  the  'Expected  Response'  was 
observed.  (See  Appendix  C  for  the  test  procedure  performed 
for  test  ST-02 . ) 

The  display  EVENT/ERROR  LOG  PARAMETERS  screen  print  must 
indicate  zero  records  in  the  error  log  CR9,  and  the  EVENT 
LOG  DATA  REQUEST  FOR  PRINTER  OUTPUT  for  Event  type  17  CR10, 
and  its  RESPONSE  CR11  screen  prints  must  indicate  there  are 
no  Event  Type  17 's  entries. 

The  length  of  the  processing  phase  (the  mission  phase  of  the 
mission  cycle)  must  not  exceed  26.7  (27  due  to  the  one 

second  resolution  of  the  system  timing) .This  was  calculated 
from  the  ADAS  Events  indicating  the  beginning  of  the  mission 
phase  timestamp  CR1  subtracted  from  the  beginning  of  the 
completion  sip  phase  timestamp  CR2,  for  mission  cycle  of  the  j 
test. . 

The  DLP  CR3  and  ITWS6  CR4  DR  summaries  must  indicate  that  75  J 

messages .  are  received  each  mission  cycle. 

(CR3  =  CR4  =  75  *  { #_of_mission_cycles ) ) .  I 

The  WMSCR  CR5  logs  must  indicate  that  50  messages  are  j 
received  during  the  first  mission  cycle,  and  75  messages  per 
mission  cycle  for  the  remainder  of  the  test. 

The  MPS  simulator  log  must  show  that  no  METAR  5  second 
alarms  (LU  #24,  DP#  05  =  0  CR7  )  or  10  second  alarms  (LU#24,  j 
DP#04  =  0  CR8  )  were  generated,  i.e'.  the  MPS  ALARM  Log  does  } 
not  contain  alarm  entries  for  5  or  10  second  throughput 
alarms . 

The  following  data  marked  with  evaluation  criteria  cross-reference  numbers  is 
a  subset  of  the  relevant  OT&E  formal  test  run  data  that  has  been  included  into 
ST-02’ s  Test  Conduct  Form  (TCF)  file,  "ST-01. TCF". 

02-13-98  03:36:47  .  Events:  0  .  Responses:  0  .  EVENT/ERROR  CMDS 


a.  [XX]  [  ] 

b.  [XX]  [  ] 

c.  [XX]  [  ] 

d.  [XX]  [  ] 

e.  [XX]  [  ] 

f.  [XX]  [  ] 
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DISPLAY  EVENT/ERROR  LOG  PARAMETERS 


ERROR  LOG  FILE  PATHNAME: 

EVENT  LOG  FILE  PATHNAME: 

ERROR  LOG  ROLLOVER  FILE  PATHNAME: 
EVENT  LOG  ROLLOVER  FILE  PATHNAME: 


/usr/adas/adasrun/data/SL/erl 
/usr/adas/adasrun/data/SL/evl 
/usr/adas/adasrun/data/SL/erl. ro 
/usr/ adas/adasrun/data/SL/evl . ro 


FILE  NAME:  BYTE  SIZE: 


RECORD  COUNT:  DATE/TIME  LAST  UPDATE: 


Fri  Feb  13  03:20:57  1998 


evl 

erl . ro 
evl . ro 


90576 

0 

0 


1982  Fri  Feb'l3  03:36:47  1998 

0  Thu  Jan  1  00:00:00  1970 

0  Thu  Jan  1  00:00:00  1970 


.  .  .  F7  ......  F8  . . 

.  F9  . 

F10  .  Fll _ 

.  F12  . 

....  F13  . . . . 

EXIT. 

,  .  F14  . 

.  02-13-98  03:37:07 

.  Events: 

0  .  Responses: 

0  . 

EVENT/ERROR 

CMDS  . 

EVENT  LOG  DATA  REQUEST  FOR  PRINTER  OUTPUT 


.PRIMARY  SEARCH  KEY  DATA: 

_  START  DATE: . 027 13?  9  8_ 

START  TIME : 00:00 : 0 0~ 


STOP  DATE:  02/13/98 
~  STOP  TIME :  0 3:37 : 0 2 


SECONDARY  SEARCH  KEY  DATA: 

BF.GI  N  EVENT  SEQUENCE  NUMBER : 
END  EVENT  SEQUENCE  NUMBER: 
EVENT"  TYPE : . . . . . 


ENTER  INTEGER  VALUE  FOR  THE  EVENT  TYPE  NUMBER. 


.  .  .  F7  . 

F8  . 

F9  .  F10  .  Fll  . 

F12  .  .  . 

EXIT. 

.  .  F13  .  F14  . 

02-13-98 

03:37:14 

.  Events:  0  .  Responses: 

0  . 

EVENT/ERROR  CMDS 

RESPONSE  CONTROL  MESSAGE 


STATUS 


- - - - I . . NAME: . [REPORT  EVNT/ERR  LOG] 

— — - _ _ _  RESPONSE _ STATUS  : _ FAILURE 

. THERE  IS  NO  EVENT/ ERROR  LOG  DATA  MATCHING  THE  SEARCH  KEYS. 


PRESS 


KEY 
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WINDOW. 


EXIT 


.  ..  F7  .  F8  .  F9  .  F10  .  Fll  .  F12  .....  F13  .....  F14 


EVENT  PRIORITY:  normal  DATE/TIME  STAMP:  02-13-98  03:28:00 

EVENT  SEQ.  NUMBER:  95  EVENT  TYPE:'  15 . CSC  ID:  12.01 

One  of  the  one  minute  cycle  phases  has  begun. 

phase:  mission _ _ _ _ 

EVENT  PRIORITY:  normal  DATE/TIME  STAMP:  02-13-98  03:28:13 

EVENT  SEQ.  NUMBER:  97  EVENT  TYPE:  15 _ CSC  ID:  12.01 

One_o f  the  one_minute  cycle_phases  has_begun. 

phase:  completion  sip  ;  ; . ; . . . . . 

EVENT  PRIORITY:  normal  DATE/TIME  STAMP:  02-13-98  03:29:00 

EVENT  SEQ.  NUMBER:  1889  EVENT  TYPE:  15 . CSC  ID:12.01 

One  of  the  one  minute  cycle  phases  has  begun. 

phase:  mission _  _ _ _ _ _ _ _ _ _ _ _ _ 

EVENT  PRIORITY:  normal  DATE/TIME  STAMP:  02-13-98  03:29:13 

EVENT  SEQ.  NUMBER:  1891  EVENT  TYPE:  15 _ CSC  ID:  12.01 

One  of  the  one  minute  cycle  phases  has  begun. 

phase :  completion  sip  ^ . . . . . ....... 

EVENT  PRIORITY:  normal  DATE/TIME  STAMP:  02-13-98  03:30:00 

EVENT  SEQ.  NUMBER:  1902  EVENT  TYPE: . 15 . CSC..  ID:  12 .01 

One  of  the  one  minute  cycle  phases  has  begun. 

phase:  mission _ _ _ _ _ _ _ _ _ _ 

EVENT  PRIORITY:  normal  DATE/TIME  STAMP:  02-13-98  03:30:16 

EVENT  SEQ.  NUMBER:  1905  EVENT  TYPE:  15 _ CSC  ID:  12.01 

One  of  the  one  minute  cycle  phases  has  begun. 

phase:  completion  sip  . . . . . 

EVENT  PRIORITY:  normal  DATE/TIME  STAMP:  02-13-98  03:31:00 

EVENT  SEQ.  NUMBER:  1919  EVENT  TYPE:  15 . CSC  ID:  12.01 

One  of  the  one  minute  cycle .phases  has _  begun.; 

phase:  mission  . . . . . . . . . . 

EVENT  PRIORITY:  normal  DATE/TIME  STAMP:  02-13-98  03:31:14 

EVENT  SEQ.  NUMBER:  1921  EVENT  TYPE:  15 _ CSC  ID:  12.01 

One  of  the  one  minute  cycle  phases  has  begun. 


phase :  completion  sip . . . 

EVENT  PRIORITY:  normal  DATE/TIME  STAMP:  02-13-98  03:32:00 

EVENT  SEQ.  NUMBER:  1929  EVENT  TYPE;  15  . CSC  ID:  12.01 

One  of  the  one  minute  cycle  phases  has  begun. 
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phase:  mission 

EVENT  PRIORITY:  normal  DATE/TIME  STAMP:  02-13-98  03:32:14 
EVENT  SEQ.  NUMBER:  1931  EVENT  TYPE:  15  CSC  ID:  12.01 

One  of  the^  one_minutej_;CYcle'','phases'"has'":begiin" . . . 

phase:  completion  sip 


EVENT  PRIORITY:  normal  DATE/TIME  STAMP:  02-13-98  03:33:00 
EVENT  SEQ.  NUMBER:  1939  EVENT  TYPE:  15  CSC  ID:  12.01 

One  of  the  one  minute  cycle  phase's"h'as"'begun'.~~  "  " 

phase:  mission 

EVENT  PRIORITY:  normal  DATE/TIME  STAMP:  02-13-98  03:33:13 
EVENT  SEQ.  NUMBER:  1944  EVENT  TYPE:  15  CSC  ID:  12.01 

cycle  phases  has  begun.  . 

phase:  completion  sip _ 


EVENT  PRIORITY:  normal  DATE/TIME  STAMP:  02-13-98  03:34:00 
EVENT  SEQ.  NUMBER:  1952  EVENT  TYPE:  15  CSC  ID:  12.01 
One  of  the  one  minute  cycle  phases  has  begun. 

phase:  mission 

EVENT  PRIORITY:  normal  DATE/TIME  STAMP:  02-13-98  03:34:14 
EVENT  SEQ.  NUMBER:  1953  EVENT  TYPE:  15  CSC  ID:  12.01 
One  of  the  one  minute :  cv^  . 

_ phase:.. completion  sip 

EVENT  PRIORITY:  normal  DATE/TIME  STAMP:  02-13-98  03:35:00 
EVENT  SEQ.  NUMBER:  1960  EVENT  TYPE:  15  CSC  ID:  12.01 
One  of  the  one  minute  cycle  phases  has  begun. 

. phase:  mission 

EVENT  PRIORITY:  normal  DATE/TIME  STAMP:  02-13-98  03:35:15 
EVENT  SEQ.  NUMBER:  1962  EVENT  TYPE:  15  CSC  ID:  12.01 
9P.®....9.?....^.!?..9....9.P.®....ni.ip.u.te  cyde  phases  has  begun. 

phase:  completion  sip _ 


EVENT  PRIORITY:  normal  DATE/TIME  STAMP:  02-13-98  03:36:00 

EVENT  SEQ.  NUMBER:  1969  EVENT  TYPE:  15 _ CSC  ID:  12.01 

One  of  the  one  minute  cycle  phases  has  begun. 

phase:  mission 

EVENT  PRIORITY:  normal  DATE/TIME  STAMP:  02-13-98  03:36:13 
EVENT  SEQ.  NUMBER:  1971  EVENT  TYPE:  15  CSC  ID:  12.01 

?.?.9....9..?....9.|}®....9.P.9....1^.P.y.te  cycle  phases  has  begun. 

_ phase:  comple t ion  sip 


EVENT  PRIORITY:  normal  DATE/TIME  STAMP:  02-13-98  03:37:00 

C-440 


EVENT  SEQ.  NUMBER:  1983  EyENT  TYPE:  15 .  CSC  ID:  12.01 

One  of  the  one  minute  cycle  ...phases [has .begun* 

phase:  mission _ _ _ _ 

EVENT  PRIORITY:  normal  DATE/TIME  STAMP:  02-13-98  03:37:14 
EVENT  SEQ.  NUMBER:  1987  EVENT  TYPE:  15  CSC  ID:  12.01 

One  of  the  one  minute  cycle  phases  has  begun. 

phase:  completion  sip  . . . .  . . . . . . . 

#####FILE:  /usr/ ips/aldars/tst/ ST- 02 /ST- 02 A. sumME  #  Feb  13  @  04:13:01 
-rw-rw-r —  1  aldars  adasteam  8559  Feb  13  03:51  ST-02A. sumME 

#####START  of  file  framing  line  ##### 

DR  of  ST-02A.METAR  for  #  of  Metar  reports  per  site 

ADU  #  1  |  (IPS):  02/13/98  03:28:11  -  (ADAS)  :  02/13/98  03 : 28  ill  | [.msgs.  23 (23) 

ADU '# 2  |  (iPsT'r’"027'i37"98’"63V2872"2'"'-"'"7MM"VV"'’027T3798  03 : 28:22  |  msgs  2  (2) 

ADU  # . 3  j . (IPS )  :  027r3/98  6X: 28 : 22  -  TaDAS j :  02/13/98  03:28:22  j  msgs  25  (25) 

ADU  #  4  |  (IPS)  :  02/13798  03:297u  -  (ADAS):  02/13/98  03:29:11  I  msgs  38  (38) 

ADU  #  5  |  (IPS):  02/ 13/98  03:29:26  -  (ADAS):  02/13/98  03:2  9:26 J  ...msgs  12  .(12) 

ADU "f . 6  j . (IPS )  :  02/13/98  03 : 30 :6T  - . (ADAS )  :  02 7 13 7 98  03 : 30:07  j  msgs  25  (25) 

ADU" '# . 7  J . (TPsTr“6T7r37M“W:307W“HMASTV"Wl3798  03:30:08  |  msgs  34  (34) 

anir #"  T~\  (TPSl!  02/1  3/98  03:30:25  -  (ADAS)_:  02/13/98  03:30:25  |  msgs  15  (15) 

ADU'  #  ”  9  j  (IPS):07/i 3/98  03  :'30: 27”-  '(ADAS  j  :"”62"/T3798  03:30:27  |  .msgs  1  (1) 

ADU'"'#"  1 0"  I . ( I PST: 02 71379 8 " 03 116: 3  9  "-""( ADAS)' ': "02/13/98  03:30:39  I  msgs  25  (25) 

ADU  #11  i . ( IPS ):0 2 /  l 3 7 9 8  03 :  3 1 :09  — . (ADAS )":  02 7 13/98  03 :  3 1 :  0 9  j  msgs  39  (39) 

ADU  #  12 . 1”'  (IPS)':  ”027l3/98"  03T3TV26”-  "(ADAS )  :  02/13/98  03:31:26  |  msgs  11  (11) 

ADU  #  13  |  (IPS)  :  02/13/98  03":  31: 39  -  (ADAS):  02/13/98  0  3 : 3 1 : 39  |  msgs  25  (25) 

ADU  "#  "  14  '1 . ( IPS )  :  62713798  03 : 32 : 09  - . (ADAS  j : "02713/98  03 : 32 : 09  j  msgs  38 . (38) 

ADU  #15  I . (  T  PsT":"  6?  / 1  3  / 88  03  732  :  26  -  (ADAS)  :  02/ 1 3 7  9 8  03:  32  :  2 6  I  msgs  12  ( 12 ) 

ADU  #  16  ”|  (IPS):  02/13/98  03:32:40  -  (ADAS):  02/13/98  03:32:40  |  msgs  25  (25) 

. . |jp3y7--'o'27l37'98'''6'3:''3'7:'6'9''- . (ADAS)  :  02713798  03:33:09  |  msgs  37 . (37) 

ADU  #18  f . (IPS)  :  02/1 3  / 9 8  03  i"3 3:2 5  ADAS )  :  02713/98  03:  33:25  J  msgs ...13  J13) 

ADU  '#  "l  9' "i . (IPS)':"  02713798  63:33:36  - . (ADAS  j  :  0271 3/98  03 :  33:36  |  msgs  25  (25) 

ADU  #  26  T  (IPS )":  "627l3798"63:34V68"'-""(/^sj7"627 1 3/98  03:34:08  I  msgs  38  (38) 

ADU  #  21  |  (IPS):  02/13/98  03:34:27  -  (ADAS):  02/13/9 8  03:34:27 . !....m.sgs  l2  .(12) 

ADU  #  22  j . (IPS)  :"  62713798  03:  34  :  39  "- . (ADAS)":"" 62/ 1 3  / 9 8  03 :  3 4  :  39  j  msgs  25 . (25) 

ADU  #23  I . riPS/:  02713798  03 :  35: 10  -  (ADAS)  :  Ol/l 3? 98  03: 35:  i' 6  I  msgs  35  (35) 

ADU  #  24  I  (IPS):  02/13798  03:35:27  -  (ADAS):  02/13/98  03:35:27  I  msgs  15  (15) 

ADU  #  25  j . (IPSf7"627l3798"'63V35  :'42"- . (ADAS  j'7~ 62713/98  03  :  35  :  42  I  msgs  25 . (25) 

ADU  #76  j( IPS) :  62713/98  03 : 36 : 10  -  (ADAS ):  62/i 3/98  03: 36:10  |  msgs  38  (38) 

ADU  #  27  j . ( IPS )  :  02/ 13 76 8  6 3: 3 6:2 6  -  (ADAS j  :  62/ 13/98  03:36:26  |  msgs  12  (12) 

ADU  #  28  j . (IPS)  :  62/13/ 98  63:36:40  - . (ADAS )" :_02 7  13/98  03:36:40  |  msgs  25  (25) 

ADU  #  29  |  (IPS)  :  02/13798  0"3 : 37:"69  -  (ADAS):  02/13/98  03:37:09  |  msgs  26  (26) 

ADU ""#""3 6""j . (iPS):62/l3/98  63:37:13  - . (ADAS j”:"" 02 713/98  03:37:13  I  msgs  22 . (22) 

AnTT#3i"i . rf  ps  r:"  627l3/  98  63  :  37  :  36  -  "(ADAS  )  :  627 13/98  03:37:  30"  |  msgs  2  ( 2 ) 

ADU  #  32  |  (IPS):  02/13/98  03:37:30  -  (ADAS):  02/13/98  03:37:30  1  msgs  25  (25) 

ADU  #  3-3 T'  ("IPS)  :  "62/13  / 9 8  03 :7 8 : i 6  -  "(ADAS)":  02/1 3/98  03:38:16  J „„msgs___37 . (37) 

AnTr"'#"34"""j""lT"PS'i'":""627'l‘3/98""6'7r38T32"'-"""(AbAsT'r"627 1 3 7  98  03:38:32  1  msgs  13  (13) 

ADU  #  35  ] . (IPS)  :  62/13/98  03  :  38  :  50  - . [ADAS  H"  027 13/ 9 8  63:38:50  j""msgs  25  (25) 

ADU  #  36  |  (IPS)  :  02/13/98  63:39:23"  -  "(ADAS ]~:”02/f3/'98  03:39:23  [  msgs  37  (37) 

ADU  #  37  |  (IPS):  02/13/98  03:39:39  -  (ADAS):  02/13/98  03:39:39  |  msgs  13  (13) 

ADU  #  38  j . (IPS)  :  62/13/98  03: 39 : 43  - . (M»AS'jT' 02/13798  03:39:43  j  msgs  25  (25) 

Total  Site  Reports  Processed _ =  875 

Total  number  of  sites . . . =....7.5 
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#####END  of  file  framing  line  ##### 


#####FILE:  /usr/ips/ aldars/ tst/ST-02/ ST-02A. sumDL  #  Feb  13  @  04:13:11 
-rw-rw-r —  1  aldars  adasteam  9525  Feb  13  04:02  ST-02A. sumDL 

#####START  of  file  framing  line  ##### 


DR 

1: 

of  ST-02A 

02/13/98 

. DLPAW  for 

03:28:19  | 

messages/site  count. 

msqs  59  |  SIZE:  4073  | 

Type: 

DLP 

Awos  | 

OMO’s  =  59 

2: 

02/13/98 

03:28:23  | 

msgs 

16  | 

SIZE: 

1106  | 

...Type : 

DLP 

Awos  | 

OMO's  =  16 

3: 

02/13/98 

03:29:20  | 

msgs 

59  | 

SIZE: 

4073  | 

Type: 

DLP 

Awos  | 

OMO’s  =  59 

4: 

02/13/98 

03:29:26  | 

msgs 

16  | 

SIZE: 

1106  | 

Type: 

DLP 

Awos  | 

OMO's  =  16 

5: 

02/13/98 

03:30:23  | 

msgs 

59  | 

SIZE: 

4073  | 

Type: 

DLP 

Awos  | 

OMO's  =  59 

6: 

02/13/98 

03:30:25  | 

msgs 

16  | 

SIZE: 

1106  | 

Type: 

DLP 

Awos  | 

OMO's  =  16 

7: 

02/13/98 

03:31:20  | 

msgs 

59  | 

SIZE: 

4073  | 

Type: 

DLP 

Awos  | 

OMO's  =  59 

8: 

02/13/98 

03:31:26  | 

msgs 

16  | 

SIZE: 

1106  | 

Type: 

DLP 

Awos  | 

OMO’s  =  16 

9: 

02/13/98 

03:32:24  | 

msgs 

59  I 

SIZE: 

4073  | 

Type: 

DLP 

Awos  I 

OMO's  =  59 

10: 

02/13/98 

03:32:26 

1  msgs 

16 

I  SIZE: 

1106 

1  Type: 

DLP 

Awos 
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#####END  of  file  framing  line  ##### 

#####FILE:  /usr/ ips/aldars/ tst/ ST- 02/ ST- 02 A. suml 6  #  Feb  13  @  04:13:21 

-rw-rw-r--  1  aldars  adasteam  9909  Feb  13  04:13  ST-02A.sumI6 

#####START  of  file  framing  line  ##### 

DR  of  ST-02A. I6AW0  for  messages/site  count. 

1:  02/13/98  03:28:18  I  msgs  58  |  SIZE:  4049  |  Type:  ITWS6  Awos  |  msgs  0x3a 

2:  02/13/98  03:28:26  | 

msgs  17  i 

SIZE:  1220  | 

Type:  ITWS6  Awos  | 

msgs  0x11 

3:  02/13/98  03:29:19  | 

msgs  58  | 

SIZE:  4049  | 

Type:  ITWS6  Awos  | 

msgs  0x3a 

4:  02/13/98  03:29:29  j 

msgs  17  j 

SIZE:  1220  | 

Type:  ITWS6  Awos  | 

msgs  0x11 

5:  02/13/98  03:30:22  i 

msgs  58  | 

SIZE:  4049  | 

Type:  ITWS6  Awos  | 

msgs  0x3a 

6:  02/13/98  03:30:38  | 

msgs  17  | 

SIZE:  1220  j 

Type:  ITWS6  Awos  | 

msgs  0x11 

7:  02/13/98  03:31:18  | 

msgs  58  | 

SIZE:  4049  | 

[  Type:  ITWS6  Awos  | 

msgs  0x3a 

8:  02/13/98  03:31:31  | 

msgs  17  1 

SIZE:  1220  | 

Type:  ITWS6  Awos  | 

msgs  0x11 

9:  02/13/98  03:32:21  j 
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SIZE:  4049 

j  Type:  ITWS6  Awos  | 

msgs  0x3a 
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|  SIZE:  1220 

|  Type:  ITWS6  Awos 

|  msgs  0x11 
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j  Type:  ITWS6  Awos 
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j  Type:  ITWS6  Awos 

|  msgs  6x11 
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|  SIZE:  4049 

|  Type:  ITWS6  Awos 

|  msgs  0x3a 
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|  Type:  ITWS6  Awos 
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|  msgs  58 

|  SIZE:  4049 

|  Type:  ITWS6  Awos 

|  msgs  0x3a 

20:  02/13/98  03:37:48 
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INPUT  MESSAGE  #:  158 


RECEIVE  TIME  {ADAS}:  02/13/98  03:35:10 


21378 

RMS  ID: 

+++++++++++■ 

0x01 

+++ 

LOGICAL  UNIT  ID: 

0x24  1 

21380 

21382 

DATE: 

DATAPOINT  ID: 

02/13/98 

0x04 

TIME: 

CONDITION 

STATUS : 

03:35:06 

0x40 

21384 

PARAMETER  VALUE: 

(00000) 

Decimal 

21387 

DATAPOINT  ID: 

0x05 

CONDITION 

STATUS : 

6x40 

21389 

PARAMETER  VALUE: 

(00000) 

Decimal 

INPUT  MESSAGE  #:  162 

RECEIVE  TIME  (ADAS):  02/13/98  03:38:56 


22258  RMS  ID: _ ; _ 0x01  _  LOGICAL  UNIT  ID:  0x24 


22260 

22277 

DATE: 

DATAPOINT 

ID: 

02/13/98 

0x04 

. TIME: 

CONDITION 

STATUS : 

03:38:26 

0x4  0 

L 

22279 

PARAMETER 

VALUE : 

(00000) 

Decimal 

22282 

DATAPOINT 

ID: 

0x05 

CONDITION 

STATUS : 

0x40 

22284 

PARAMETER 

VALUE : 

(00000) 

Decimal 

#####FILE:  /usr/ips/ aldars/tst/ ST- 02 /ST- 02 A. lddl 6  #  Feb  13  @  04:13:46 

-rw-rw-r--  1  aldars  adasteam  32177  Feb  13  04:05  ST-02A.lddI6 
#####START  of  file  framing  line  ##### 
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EXECUTIVE  SUMMARY 


This  report  contains  the  results  of  the  Operational  Test  and  Evaluation 
(OT&E)  re-testing  of  the  Automated  Lightning  Detection  and  Reporting  System 
(ALDARS)  Remote  Monitoring  Subsystem  (RMS)  for  software  Versions  4.18  and 
4.19.  The  OT&E  was  initially  performed  at  the  FAA  William  J.  Hughes  Technical 
Center,  Atlantic  City  International  Airport,  NJ  from  September  17  to  October 
24,1997.  Fifteen  Test  Trouble  Reports  (TTRs)  were  prepared  for  the  problems 
encountered  during  the  course  of  testing.  Re-testing  (Version  4.19)  was 
conducted  from  February  5  to  March  6  for  the  purpose  of  evaluating  the  status 
of  the  original  15  TTR' s .  Attachment  A  contains  a  summary  of  all  the  TTRs 
generated  and  their  current  status.  Attachment  B  contains  a  copy  of  all  the 
TTRs  generated.  • 

The  NAS  OT&E  Integration  testing  was  performed  to  verify  that  the  ALDARS  RMS 
functioned  as  an  integrated  component  of  the  Remote  Maintenance  Monitoring 
Subsystem  (RMMS) ,  and  to  ensure  that  NAS-SS-1000  (Volumes  I,  III,  and  V),  and 
ADAS/ALDARS  system  requirements  were  satisfied. 

OT&E  Integration  testing  of  the  RMS  interface  was  performed  by  ACT-330 
utilizing  the  ADAS/ALDARS  system  at  the  WJHTC.  The  Maintenance  Processor 
System  (MPS)  ACT-330  testbed  at  the  WJHTC  utilized  a  D30  TANDEM  Operating 
System  with  Version  $CM81  Interim  Monitor  and  Control  Software  (IMCS)  resident 
on  a  test  pathway.  The  ALDARS  decoder  version  of  August  5,  1997  was  installed 
in  the  IMCS. 

OT&E  Integration  testing  concentrated  on  the  ALDARS  interface,  but  included 
some  testing  of  the  previously  deployed  ADAS.  The  test  strategy  centered  on 
the  expectation  that  the  addition  of  ADAS/ALDARS  interface  would  be  completed 
without  affecting  the  operation  of  the  existing  system.  Monitoring  tests  were 
performed  for  each  data  point  in  the  ALDARS  Logical  Units  (LU) .  A  PC  was  used 
to  view  IMCS  screens  and  access  TANDEM  data  information.  Additional  testing 
was  performed  on  other  LUs. 

Of  the  original  15  TTRs,  10  were  categorized  as  major,  2  as  minor,  and  3 
annoyance  (reference  DOD-STD-2 167A) .  Only  four  TTRs  remain  open.  They  are: 
001,  002,  011  and  013.  The  following  is  an  explanation  as  to  why  the  four 
TTRs  remain  open  and  suggested  resolutions: 

001  and  002  -  Although  these  two  TTRs  remain  open  they  have  been  downgraded 
from  Priority  II  (Major)  to  Other. 

011  -  During  re-testing  LUID  2101  (UNIX  Console)  now  toggles  from  "In  Use"  to 
Not  In  Use",  but  2102  (ASC  Console)  always  remains  "In  Use". 

013  -  The  title  of  this  IMCS  screen  (LU2A)  is  incorrect.  It  should  be  "WARP 
Communications",  not  RWP  Communications.  Also,  LUID  200D  should  be  changed 
from  "comm_rwp"  to  "comm_warp" 

In  conclusion,  the  ALDARS  performed  satisfactorily  during  the  course  of  the 
OT&E.  After  the  TTRs  have  been  addressed,  ALDARS  should  be  prepared  to  make 
the  transition  into  the  production  phase.  ACT-330  in  coordination  with 
program  management  will  determine  what  level  of  Regression/  Delta  testing  will 
be  conducted  and  at  which  prototype  site(s). 
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problems  noted  during  the  OT4E  are  documented  in  the  TTRs  enclosed.  Priority  levels  are  assigned  in 
rdance  with  guidelines  provided  in  DOD-STD-2167A  and  are  presented  below: 
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Priority  (Other) .  All  other  errors. 
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Discrepancy  in  the  data  point  name  of  LU2A.  IV  -  Annoyance 

"RWP  Comm."  should  be  "WARP  Communications". 
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ALDARS  OT&E  Test  Trouble  Report 


System  Under  Test 

ALDARS 

Date  Problem  Found 

9/24/97 


Software  Release 

Ver.  4.19 

Date  Problem  Submitted 

10/22/97 


TTR  Status  TTR  Number 

OPEN  1 

Problem  Area 

ALDARS 


Priority 

Other 

Phone 

609-485-7395 

MPS  System 

\ACTA 


Originator 

PHIL  HOANG 


Organization 

ACT-330 


Fax  E-mail  Address 

609-485-5995  phil_hoang@admin . tc . faa . gov 


MPS  Operating  System  IMCS  Version 

D30  $CM81 


Decoder  Version 

August  5,  1997 


System  Response  Message 

MFC#43  -  State  Change,  CSC#40  -  Normal 


Short  Description  Of  Problem 

Messages  contain  incorrect  message  function  and  condition  status  codes. 


Detailed  Description  Of  Problem 

ADAS/ALDARS  RMS  sends  incorrect  message  function  and  condition  status  codes 
for  LUID  2801 (log_status) and  2802  (event_status ) .  These  data  points  should 
generate  alarm  and  return  to  normal  messages,  not  state  change  messages. 

When  the  printers (LU28 ) are  off-line,  ADAS/ALDARS  RMS  incorrectly  sends  state 
change  messages  instead  of  alarm  messages,  and  includes  condition  status 
codes  of  normal  instead  of  alarm. 

When  the  printers  are  back  on-line,  ADAS/ALDARS  RMS  incorrectly  sends  state 
change  messages  instead  of  return  to  normal  messages. 

NOTE:  This  TTR  was  downgraded  as  a  result  of  Key  Site  Issue  #4 


Retest  Performed  By  Retested  In  Version 

Don  Hartman  4.19 

Date  Of  Retest  Retest  Indicates  Problem  Resolved  Disposition  of  Problem 

2/5  -  3/6/98  0PEN 


Retest  Required 

Yes 
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ALDARS  OT&E  Test  Trouble  Report 


System  Under  Test 

ALDARS 

Date  Problem  Found 

9/24/97 


Software  Release 

Ver.  4.19 

Date  Problem  Submitted 

10/22/97 


TTR  Status  TTR  Number 

OPEN  2 

Problem  Area 

ALDARS 


Priority 

Other 


Originator 

PHIL  HOANG 


Organization 

ACT-330 


Phone  Fax 

609-485-7395  609-485-5995 


E-mail  Address 

phil_hoang@admin. tc. faa .  gov 


MPS  System 

MPS  Operating  System 

IMCS  Version 

\ACTA 

D30 

$CM8 1 

Decoder  Version 

August  5,  1997 


System  Response  Message 

MFC#43  -  State  Change,  CSC#40  -  Normal 


Short  Description  Of  Problem 

No  alarm  reported  for  LUID  200B  (printers  status) 


Detailed  Description  Of  Problem 

No  alarm  is  generated  by  the  ADAS/ALDARS  RMS  when  the  ASC  printer  and  the 
event  log  printer  are  powered  off.  The  status  of  LUID  200B  is  not  updated  to 
reflect  an  alarmed  condition,  and  remains  in  the  NORMAL  status.  This  TTR  is 
related  to  TTR1 . 

NOTE:  This  TTR  was  downgraded  as  a  result  of  Key  Site  Issue  #4 


Retest  Required 

Yes 

Date  Of  Retest 

2/5  -  3/6/98 


Retest  Performed  By 

Don  Hartman 

Retest  Indicates  Problem  Resolved 


Retested  In  Version 

4.19 

Disposition  of  Problem 

OPEN 
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ALDARS  OT&E  Test  Trouble  Report 


System  Under  Test 

ALDARS 


Software  Release 

Ver.  4.19 


TTR  Status 

Closed 


TTR  Number 

3 


Date  Problem  Found  Date  Problem  Submitted 

9/29/97  10/22/97 


Priority  Originator 

4  -  Annoyance  PHIL  HOANG 


Problem  Area 

ALDARS 

Organization 

ACT-330 


Phone 

609-485-7395 

MPS  System 

\ACTA 


Fax 

609-485-5995 

MPS  Operating  System 

D30 


E-mail  Address 

phil_hoang@admin. tc. faa.gov 


IMCS  Version 

$CM81 


Decoder  Version 

August  5,  1997 


System  Response  Message 

N/A 


Short  Description  Of  Problem 

Incorrect  data  point  descriptions  in  LU  20 


Detailed  Description  Of  Problem 

ADAS/ALDARS  displays  "Operational  Mode"  as  the  description  of  LUID  2002.  It 
should  be  "sys  mode"  per  NAS-IC-25085103,  Revision  D  and  E.  The  MPS  displays 
the  correct  description. 

ADAS/ALDARS  displays  "Initialization  Mode"  as  the  description  of  LUID  2003. 

It  should  be  "sys_init"  per  NAS-IC-25085103,  Revision  D  and  E.  The  MPS 
displays  the  correct  description. 

ADAS/ALDARS  displays  "RMS/MAI NT  RESET"  as  the  description  of  LUID  2004.  It 
should  be  "mp  reset"  per  NAS-IC-25085103,  Revision  E.  The  MPS  displays  the 
correct  description. 


Retest  Required  Retest  Performed  By 

Yes  Don  Hartman 


Retested  In  Version 

4.19 


Date  Of  Retest  Retest  Indicates  Problem  Resolved  Disposition  of  Problem 

2/5  -  3/6/98  Closed 
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ALDARS  OT&E  Test  Trouble  Report 


System  Under  Test  Software  Release  TTR  Status 

ALDARS  Ver .  4.19  Closed 


TTR  Number 
4 


Date  Problem  Found  Date  Problem  Submitted 

9/29/97  10/22/97 


Problem  Area 

MPS  Decoder 


Priority 

2  -  Major 

Phone 

609-485-7395 

MPS  System 

\ACTA 


Originator 

PHIL  HOANG 


Organi ration 

ACT- 330 


Fax  E-mail  Address 

609-485-5995  phil_hoang@admin.tc.faa.gov 

MPS  Operating  System  IMCS  Version  Decoder  Version 

D30  $CM81  August  5,  1997 


System  Response  Message 

N/A 


Short  Description  Of  Problem 

Incorrect  values  displayed  for  several  data  points  in  LU20 

Detailed  Description  Of  Problem 

ADAS/ALDARS  displays  "Normal"  for  LUIDs  200C,  200D,  200E,  209C,  and  209A,  but 
MPS  displays  "Not  Monitored"  for  those  datapoints . 


In  accordance  with  NAS-IC-25085103,  Revision  D  and  E,  the  only  recommended 
values  for  these  data  points  are  "normal"  and  "presence  of  an  alarm" 


Retest  Required  Retest  Performed  By  Retested  In  Version 

Yes  Don  Hartman  4.19 


Date  Of  Retest 

2/5  -  3/6/98 


Retest  Indicates  Problem  Resolved  Disposition  of  Problem 

Closed 
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ALDARS  OT&E  Test  Trouble  Report 


System  Under  Test  Software  Release 

ALDARS  Ver.  4.19 


TTR  Status 

Closed 


TTR  Number 

5 


Date  Problem  Found  Date  Problem  Submitted 

9/29/97  10/22/97 


Problem  Area 

ADAS /ALDARS 


Priority 

2  -  Major 

Phone 

609-485-7395 

MPS  System 

\ACTA 


Originator 

PHIL  HOANG 


Organi ration 

ACT-330 


Fax 

609-485-5995 


E-mail  Address 

phil_hoang@admin.tc. faa .gov 


MPS  Operating  System  IMCS  Version 

D30  $CM81 


Decoder  Version 

August  5,  1997 


System  Response  Message 

N/A 


Short  Description  Of  Problem 

Discrepancy  in  data  point  values  for  LUIDs  2302  and  2303  (MPS  Comm. ) . 


Detailed  Description  Of  Problem 

MPS  displays  "569"  for  the  datapoint  value  of  LUID  2302,  but  ADAS/ALDARS 
displays  "168". 

MPS  displays  "566"  for  the  datapoint  value  of  LUID  2303,  but  ADAS/ALDARS 
displays  "167". 


Retest  Required  Retest  Performed  By 

Yes  Don  Hartman 


Retested  In  Version 

4.19 


Date  Of  Retest  Retest  Indicates  Problem  Resolved  Disposition  of  Problem 

2/5  -  3/6/98  Closed 


D  - 1 1 


ALDARS  OT&E  Test  Trouble  Report 


System  Under  Test  Software  Release  TTR  Status 

ALDARS  Ver.  4.19  Closed 


TTR  Number 

6 


Date  Problem  Found  Date  Problem  Submitted 

10/1/97  10/22/97 


Problem  Area 

MPS  Decoder 


Priority 

2  -  Major 

Phone 

609-485-7395 

MPS  System 

\ACTA 


Originator 

PHIL  HOANG 


Organization 

ACT-330 


Fax 

609-485-5995 

MPS  Operating  System 

D30 


E-mail  Address 

phil_hoang@admin . tc. faa . gov 


ZMCS  Version 

$CM81 


Decoder  Version 

August  5,  1997 


System  Response  Message 

N/A 


Short  Description  Of  Problem 

Discrepancy  in  data  point  values  for  LUIDs  2402,  2403,  2404,  and  2405 

Detailed  Description  Of  Problem 

ADAS/ALDARS  displays  "0"  for  the  values  of  LUIDs  2402,  2403,  2404  and  2405, 
but  MPS  displays  "Not  Monitored". 


Retest  Required  Retest  Performed  By  Retested  In  Version 

Yes  Don  Hartman  4.19 


Date  Of  Retest 

2/5  -  3/6/98 


Retest  Indicates  Problem  Resolved  Disposition  of  Problem 

Closed 


D  - 12 


ALDARS  OT&E  Test  Trouble  Report 


System  Under  Test  Software  Release  TTR  Status 

ALDARS  Ver,  4.19  Closed 


TTR  Number 

7 


Date  Problem  Found  Date  Problem  Submitted 

10/1/97  10/22/97 


Problem  Area 

ADAS /ALDARS 


Priority  Originator 

2  -  Major  PHIL  HOANG 


Organization 

ACT- 330 


Phone  Fax 

609-485-7395  609-485-5995 


E-mail  Address 

phil_hoang@admin . tc . f aa . gov 


MPS  System  MPS  Operating  System 

\ACTA  D30 


IMCS  Version 

$CM81 


Decoder  Version 

August  5,  1997 


System  Response  Message 

N/A 


Short  Description  Of  Problem 

Discrepancy  in  data  point  value  for  LUID  2505 


Detailed  Description  Of  Problem 

MPS  displays  "2998"  for  the  value  of  LUID  2505,  but  ADAS/ALDARS  displays 
"2876". 


Retest  Required  Retest  Performed  By 

Yes  Don  Hartman 


Retested  In  Version 

4.19 


Date  Of  Retest 

2/5  -  3/6/98 


Retest  Indicates  Problem  Resolved  Disposition  of  Problem 

Closed 


D-13 


ALDARS  OT&E  Test  Trouble  Report 

TTR  Status  TTR  Number 

Closed  8 

Date  Problem  Found  Date  Problem  Submitted  Problem  Area 


10/1/97 

10/22/97 

ADAS/ALDARS 

Priority 

2  -  Major 

Originator 

PHIL  HOANG 

Organization 

ACT-330 

Phone 

609-485-7395 

Fax 

609-485-5995 

E-mail  Address 

phil_hoang@admin . tc . 

faa.gov 

MPS  System 

\ACTA 

MPS  Operating  System 

D30 

IMCS  Version 

$CM81 

Decoder  Version 

August  5,  1997 

System  Under  Test  Software  Release 

ALDARS  Ve  r .  4 . 1 9 


System  Response  Message 

N/A 


Short  Description  Of  Problem 

Discrepancy  in  data  point  value  for  LUID  2607 


Detailed  Description  Of  Problem 

MPS  displays  "77280"  for  the  datapoint  value  of  LUID  2607,  but  ADAS/ALDARS 
displays  "30912". 


Retest  Required  Retest  Performed  By 

Yes  Don  Hartman 


Retested  In  Version 

4.19 


Date  Of  Retest 

2/5  -  3/6/98 


Retest  Indicates  Problem  Resolved  Disposition  of  Problem 

Closed 


D- 14 


System  Under  Test 

ALDARS 


ALDARS  OT&E  Test  Trouble  Report 


Software  Release  TTR  Status 

Ver.  4.19  Closed 


TTR  Humber 

$ 


Date  Problem 

10/1/97 

Priority 

3  -  Minor 


Found  Date  Problem  Submitted 

10/22/97 

Originator 

PHIL  HOANG 


Problem  Area 

ADAS /ALDARS 

Organi ration 

ACT- 330 


Phone  Fax 

609-485-7395  609-485-5995 


E-mail  Address 

phil_hoang@admin.tc. faa.gov 


MPS  System  MPS  Operating  System  IMCS  Version 

\ACTA  D30  $CM81 


Decoder  Version 

August  5,  1997 


System  Response  Message 

N/A 


Short  Description  Of  Problem 

Incorrect  datapoint  description  between  MPS  and  ADAS / Al DARS  RMS 


Detailed  Description  Of  Problem 

ADAS/ALDARS  RMS  LU4001  displays  "NADIN/LCN  Controller",  and  the  MPS  screen 
LU4001  displays  "ctlr_stat_0" . 

In  accordance  with  NAS-IC-25085103,  Revision  D  and  E,  the  recommended 
datapoint  description  for  LU4001  is  "ctlr_stat_0" . 


Retest  Required  Retest  Performed  By 

Yes  Don  Hartman 


Retested  In  Version 

4.19 


Date  Of  Retest  Retest  Indicates  Problem  Resolved  Disposition  of  Problem 

2/5  -  3/6/98  Closed 


D- 15 


ALDARS  OT&E  Test  Trouble  Report 

System  Under  Test  Software  Release  TTR  Status  TTR  Number 


ALDARS 

Ver.  4.19 

Closed 

10 

Date  Problem 

10/1/97 

Found  Date  Problem 

10/1/97 

Submitted 

Problem  Area 

ADAS/ALDARS 

Priority 

2  -  Major 

Originator 

PHIL  HOANG 

Organization 

ACT-330 

Phone 

609-485-7395 

Fax 

609-485-5995 

E-mail  Address 

phil_hoang@admin . tc . 

,  faa . gov 

MPS  System 

\ACTA 

MPS  Operating  System  IMCS  Version 

D30  $CM81 

Decoder  Version 

August  5,  1997 

System  Response  Message 

N/A 


Short  Description  Of  Problem 

Incorrect  datapoint  value  between  MPS  and  ADAS/ALDARS  RMS  for  NLDN 
Communications  (LUID  2D) . 


Detailed  Description  Of  Problem 

ADAS/ALDARS  RMS  displays  "27664"  for  LU2D02,  but  MPS  displays  "0". 

ADAS/ALDARS  RMS  displays  "1"  for  LU2D04,  but  MPS  displays  "NOT  MONITORED". 
In  accordance  with  NAS-IC-25085103,  Revision  D  and  E,  the  recommended  value 
for  LU2D04  should  be  in  the  range  of  0  to  4294967295. 


Retest  Required  Retest  Performed  By 

Yes  Don  Hartman 


Retested  In  Version 

4.19 


Date  Of  Retest 

2/5  -  3/6/98 


Retest  Indicates  Problem  Resolved  Disposition  of  Problem 

Closed 


D  - 16 


ALDARS  OT&E  Test  Trouble  Report 


System  Under  Test  Software  Release 

ALDARS  Ver.  4.19 


TTR  Status 

OPEN 


TTR  Number 

11 


Date  Problem  Found  Date  Problem  Submitted 

10/22/97  10/22/97 


Problem  Area 

ALDARS 


Priority  Originator 

3  -  Minor  Don  Hartman 


Organization 

ACT-330 


Phone  Fax  E-mail  Address 

609-485-4316  609-485-7039  don_hartman@admin.tc.faa.gov 


MPS  System  MPS  Operating  System  IMCS  Version 

\ACTA  D30  $CM81 


Decoder  Version 

August  5,  1997 


System  Response  Message 

N/A 


Short  Description  Of  Problem 

Incorrect  datapoint  value  on  the  MPS  for  LUID21  (Terminal  Communications). 


Detailed  Description  Of  Problem 

ADAS/UNIX  console  was  logged  off  and  unplugged,  however  LU2101  for  MPS 
displays  "In  Use".  (This  function  is  now  OK.) 

ADAS /ASC  console  was  logged  off  and  unplugged,  however  LU2102  for  MPS 
displays  "In  Use". 


Retest  Required  Retest  Performed  By 

Yes  Don  Hartman 


Retested  In  Version 

4.19 


Date  Of  Retest  Retest  Indicates  Problem  Resolved  Disposition  of  Problem 

2/5  -  3/6/98  0PEN 


D- 17 


ALDARS  OT&E  Test  Trouble  Report 

System  Under  Test  Software  Release  TTR  Status  TTR  Number 


ALDARS 

Ver.  4.19 

Closed 

12 

Date  Problem 

10/20/97 

Found  Date  Problem 

10/22/97 

Submitted 

Problem  Area 

ALDARS 

Priority 

4  -  Annoyance 

Originator 

Don  Hartman 

Organization 

ACT-330 

Phone 

609-485-4316 

Fax 

609-485-7039 

E-mail  Address 

don_hartman@admin . 

,  tc . f aa . gov 

MPS  System 

\ACTA 

MPS  Operating  System  IMCS  Version 

D30  $  CM8 1 

Decoder  Version 

August  5,  1997 

System  Response  Message 

N/A 


Short  Description  Of  Problem 

Duplication  of  LUID  datapoint  and  descriptions. 

Detailed  Description  Of  Problem 

ADAS/ALDARS  RMS  displays  LU4005  twice;  once  at  the  bottom  of  page  1,  and 
again  at  the  top  of  page  2. 


Retest  Required  Retest  Performed  By  Retested  In  Version 

Yes  Don  Hartman  4.19 


Date  Of  Retest 

2/5  -  3/6/98 


Retest  Indicates  Problem  Resolved  Disposition  of  Problem 

Closed 


D- 18 


ALDARS  OT&E  Test  Trouble  Report 


System  Under  Test  Software  Release 

ALDARS  Ver.  4.19 


TTR  Status 

OPEN 


TTR  Number 

13 


Date  Problem  Found  Date  Problem  Submitted 

10/1/97  10/22/97 


Problem  Area 

ALDARS 


Priority  Originator 

4  -  Annoyance  Don  Hartman 


Organization 

ACT- 330 


Phone 

609-485-4316 


Fax  E-mail  Address 

609-485-7039  don_hartman@admin . tc . faa.gov 


MPS  System  MPS  Operating  System  1MCS  Version 

\ACTA  D30  $CM81 


Decoder  Version 

August  5,  1997 


System  Response  Message 

N/A 


Short  Description  Of  Problem 

Discrepancy  in  the  datapoint  name  of  LU2A  (WARP  Communications) . 

Detailed  Description  Of  Problem 

ADAS /ALDARS  RMS  displays  "WARP  COMMUNICATIONS"  for  LU2A,  but  MPS  displays 
"RWP  Communications"  .  It  should  be  "WARP  Communications  per  NAS-IC 
25085103,  Revision  D  and  E. 

Also,  LU200D  description  should  be  updated  from  "comm_rwp"  to  "comm_warp". 


Retest  Required  Retest  Performed  By 

Yes  Don  Hartman 


Retested  In  Version 

4.19 


Date  Of  Retest 

2/5  -  3/6/98 


Retest  Indicates  Problem  Resolved  Disposition  of  Problem 

OPEN 


D- 19 


ALDARS  OT&E  Test  Trouble  Report 

System  Under  Test  Software  Release  TTR  Status  TTR  Number 


ALDARS 

Ver.  4.19 

Closed 

14 

Date  Problem 

10/6/97 

Found  Date  Problem 

10/22/97 

Submitted 

Problem  Area 

ALDARS 

Priority 

2  -  Major 

Originator 

Don  Hartman 

Organization 

SRC 

Phone 

609-485-4316 

Fax 

609-485-7039 

E-mail  Address 

don_hartman@admin . 

,  tc .  f  aa  .-gov 

MPS  System 

\ACTA 

MPS  Operating  System  IMCS  Version 

D30  $CM81 

Decoder  Version 

August  5,  1997 

System  Response  Message 

N/A 


Short  Description  Of  Problem 

No  threshold  changes  allowed  for  LUID  2D03 


Detailed  Description  Of  Problem 

Could  not  perform  threshold  changes  from  ASC. 


Retest  Required  Retest  Performed  By 

Yes  Don  Hartman 


Retested  In  Version 

4.19 


Date  Of  Retest 

2/5  -  3/6/98 


Retest  Indicates  Problem  Resolved  Disposition  of  Problem 

Closed 


D  -  20 


ALDARS  OT&E  Test  Trouble  Report 


System  Under  Test  Software  Release 

ALDARS  Ver.  4.19 


TTR  Status 

Closed 


TTR  Number 

15 


Date  Problem  Found  Date  Problem  Submitted 

9/30/97  10/22/97 


Problem  Area 

ALDARS 


Priority 

2  -  Major 


Originator 

Don  Hartman 


Organization 

SRC 


Phone  Fax 

609-485-4316  609-485-7039 


E-mail  Address 

don  hartman@admin.tc.faa.gov 


MPS  System  MPS  Operating  System 

\ACTA  D30 


IMCS  Version 

$CM81 


Decoder  Version 

August  5,  1997 


System  Response  Message 

N/A 


Short  Description  Of  Problem 

Updated  status  message  took  more  than  the  required  time  per  ICD 


Detailed  Description  Of  Problem 

When  the  alarm  for  LUID  2401  was  cleared,  the  updated  status  took 
approximately  5  minutes  to  show  up  on  the  MPS  site  status  screen  for  L 
(Time  Management) . 


Retest  Required 

Yes 

Date  Of  Retest 

2/5  -  3/6/98 


Retest  Performed  By  Retested  In  Version 

Don  Hartman  4.19. 

Retest  Indicates  Problem  Resolved  Disposition  of  Problem 

Closed 


D-21 


APPENDIX  E 


DLP  TEST  WAIVER  LETTER 


